Max level shown:
1 [ Nov 14 06:19:16 Enabled. ]
2 [ Nov 14 06:19:16 Rereading configuration. ]
3 [ Nov 14 06:19:18 Rereading configuration. ]
4 [ Nov 14 06:19:26 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Nov 14 06:19:26 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-11-14T06:19:26.538ZDEBGnexus: registered DTrace probes
82024-11-14T06:19:26.539ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:74
92024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-11-14T06:19:26.550ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-11-14T06:19:26.551ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-11-14T06:19:26.551ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-11-14T06:19:26.566ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-11-14T06:19:26.569ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-11-14T06:19:26.573ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-11-14T06:19:26.580ZDEBGnexus (ServerContext): registered USDT probes
672024-11-14T06:19:26.680ZINFOnexus: Database schema version is up to date desired_version = 114.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 114.0.0
682024-11-14T06:19:26.684ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 247164153 } })
692024-11-14T06:19:26.684ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
702024-11-14T06:19:26.684ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
712024-11-14T06:19:26.738ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
722024-11-14T06:19:26.739ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-11-14T06:19:26.742ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9f9242e-46fd-4220-886c-3600d54e3fb2", "content-length": "26", "date": "Thu, 14 Nov 2024 06:19:26 GMT"} })
742024-11-14T06:19:26.742ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-11-14T06:19:26.742ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-11-14T06:19:26.773ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 335914185 } })
772024-11-14T06:19:26.773ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
782024-11-14T06:19:26.805ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
792024-11-14T06:19:26.805ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-11-14T06:19:26.805ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d5d41ca-dd18-440b-b1e4-7e61f3282dc1", "content-length": "26", "date": "Thu, 14 Nov 2024 06:19:26 GMT"} })
812024-11-14T06:19:26.805ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-11-14T06:19:26.806ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-11-14T06:19:26.878ZDEBGnexus (clickhouse-client): registered USDT probes id = b10bea24-35fa-4eb0-a0bd-a20be60b9024
842024-11-14T06:19:26.878ZDEBGnexus (clickhouse-client): registered USDT probes id = b10bea24-35fa-4eb0-a0bd-a20be60b9024
852024-11-14T06:19:26.889ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
862024-11-14T06:19:26.907ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
872024-11-14T06:19:26.910ZDEBGnexus (DataLoader): attempting to create built-in users
882024-11-14T06:19:26.910ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
892024-11-14T06:19:26.910ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
902024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
912024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks versions = all
922024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate versions = all
932024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
942024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /clickhouse/policy versions = all
952024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /clickhouse/policy versions = all
962024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
972024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
982024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
992024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
1002024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1012024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga versions = all
1022024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1032024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all versions = all
1042024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1052024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1062024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import versions = all
1072024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1082024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target versions = all
1092024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target versions = all
1102024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1112024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1122024-11-14T06:19:26.933ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id} versions = all
1132024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1142024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors versions = all
1152024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1162024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers versions = all
1172024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1182024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge versions = all
1192024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled} versions = all
1202024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1212024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas versions = all
1222024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id} versions = all
1232024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1242024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1252024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1262024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add versions = all
1272024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge versions = all
1282024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized versions = all
1292024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id} versions = all
1302024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1312024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1322024-11-14T06:19:26.934ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:12221
1332024-11-14T06:19:26.934ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1342024-11-14T06:19:26.934ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1352024-11-14T06:19:26.934ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1362024-11-14T06:19:26.944ZWARNnexus: Cannot look up rack: Object (of type ById(f391bffc-9f2b-4c87-85cd-2718afa7cb93)) not found: rack file = nexus/src/app/rack.rs:774
1372024-11-14T06:19:26.948ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1382024-11-14T06:19:26.948ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1392024-11-14T06:19:26.949ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1402024-11-14T06:19:26.949ZDEBGnexus (DataLoader): attempting to create built-in roles
1412024-11-14T06:19:26.949ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1422024-11-14T06:19:26.949ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1432024-11-14T06:19:26.974ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1442024-11-14T06:19:26.974ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1452024-11-14T06:19:26.975ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1462024-11-14T06:19:26.975ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1472024-11-14T06:19:26.975ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1482024-11-14T06:19:26.975ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1492024-11-14T06:19:27.301ZINFOnexus (DataLoader): created 4 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1502024-11-14T06:19:27.301ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1512024-11-14T06:19:27.302ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1522024-11-14T06:19:27.303ZDEBGnexus (DataLoader): attempting to create built-in silos
1532024-11-14T06:19:27.303ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542024-11-14T06:19:27.303ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552024-11-14T06:19:27.428ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:57091
1562024-11-14T06:19:27.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
1572024-11-14T06:19:27.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
1582024-11-14T06:19:27.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
1592024-11-14T06:19:27.463ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
1602024-11-14T06:19:27.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
1612024-11-14T06:19:27.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
1622024-11-14T06:19:27.544ZINFOnexus (DataLoader): created 2 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1632024-11-14T06:19:27.544ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-11-14T06:19:27.544ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-11-14T06:19:27.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
1662024-11-14T06:19:27.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
1672024-11-14T06:19:27.563ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1682024-11-14T06:19:27.564ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1692024-11-14T06:19:27.564ZDEBGnexus (DataLoader): attempting to create built-in projects
1702024-11-14T06:19:27.564ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712024-11-14T06:19:27.565ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722024-11-14T06:19:27.606ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1732024-11-14T06:19:27.606ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1742024-11-14T06:19:27.667ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f setting = cluster.preserve_downgrade_option uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete value = 22.1
1752024-11-14T06:19:27.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
1762024-11-14T06:19:27.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
1772024-11-14T06:19:27.671ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "f391bffc-9f2b-4c87-85cd-2718afa7cb93" error_message_internal = not found: rack with id "f391bffc-9f2b-4c87-85cd-2718afa7cb93" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 243087 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = e26a1fc7-645c-4c87-b8bd-c0b7e3c90a6f response_code = 404 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
1782024-11-14T06:19:28.142ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1792024-11-14T06:19:28.143ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1802024-11-14T06:19:28.500ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1812024-11-14T06:19:28.501ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1822024-11-14T06:19:28.501ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1832024-11-14T06:19:28.502ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1842024-11-14T06:19:28.554ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1852024-11-14T06:19:28.555ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1862024-11-14T06:19:28.556ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1872024-11-14T06:19:28.558ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1882024-11-14T06:19:28.558ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892024-11-14T06:19:28.559ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1902024-11-14T06:19:28.599ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1912024-11-14T06:19:28.600ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922024-11-14T06:19:28.600ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1932024-11-14T06:19:28.601ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1942024-11-14T06:19:28.601ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952024-11-14T06:19:28.601ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1962024-11-14T06:19:28.602ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972024-11-14T06:19:28.602ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982024-11-14T06:19:28.604ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1992024-11-14T06:19:28.604ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2002024-11-14T06:19:28.606ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2012024-11-14T06:19:28.606ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2022024-11-14T06:19:28.607ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032024-11-14T06:19:28.607ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042024-11-14T06:19:28.609ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052024-11-14T06:19:28.612ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2062024-11-14T06:19:28.612ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072024-11-14T06:19:28.612ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082024-11-14T06:19:28.613ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-11-14T06:19:28.613ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102024-11-14T06:19:28.642ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112024-11-14T06:19:28.642ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122024-11-14T06:19:28.644ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132024-11-14T06:19:28.646ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2142024-11-14T06:19:28.646ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2152024-11-14T06:19:28.646ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2162024-11-14T06:19:28.725ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172024-11-14T06:19:28.725ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2182024-11-14T06:19:28.726ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2192024-11-14T06:19:28.727ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2202024-11-14T06:19:28.729ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2212024-11-14T06:19:28.729ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2222024-11-14T06:19:28.731ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2232024-11-14T06:19:28.734ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2242024-11-14T06:19:28.734ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2252024-11-14T06:19:28.734ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2262024-11-14T06:19:28.744ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2272024-11-14T06:19:28.745ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2282024-11-14T06:19:28.752ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292024-11-14T06:19:28.753ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2302024-11-14T06:19:28.755ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2312024-11-14T06:19:28.755ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2322024-11-14T06:19:28.757ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2332024-11-14T06:19:28.757ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2342024-11-14T06:19:28.758ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2352024-11-14T06:19:28.759ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2362024-11-14T06:19:28.760ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2372024-11-14T06:19:28.760ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2382024-11-14T06:19:28.761ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2392024-11-14T06:19:28.761ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2402024-11-14T06:19:28.762ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2412024-11-14T06:19:28.765ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2422024-11-14T06:19:28.765ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2432024-11-14T06:19:28.766ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2442024-11-14T06:19:28.767ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2452024-11-14T06:19:28.767ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2462024-11-14T06:19:28.768ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2472024-11-14T06:19:28.768ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2482024-11-14T06:19:28.769ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2492024-11-14T06:19:28.772ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2502024-11-14T06:19:28.772ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2512024-11-14T06:19:28.772ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2522024-11-14T06:19:28.821ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2532024-11-14T06:19:28.822ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2542024-11-14T06:19:28.823ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2552024-11-14T06:19:28.823ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2562024-11-14T06:19:28.824ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2572024-11-14T06:19:28.825ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2582024-11-14T06:19:28.826ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592024-11-14T06:19:28.829ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2602024-11-14T06:19:28.829ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612024-11-14T06:19:28.830ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2622024-11-14T06:19:28.915ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2632024-11-14T06:19:28.915ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2642024-11-14T06:19:28.915ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2652024-11-14T06:19:28.916ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2662024-11-14T06:19:28.917ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2672024-11-14T06:19:28.919ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2682024-11-14T06:19:28.919ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2692024-11-14T06:19:28.920ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2702024-11-14T06:19:28.921ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2712024-11-14T06:19:28.922ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2722024-11-14T06:19:28.922ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2732024-11-14T06:19:28.923ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2742024-11-14T06:19:28.924ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2752024-11-14T06:19:28.925ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2762024-11-14T06:19:28.928ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2772024-11-14T06:19:28.928ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2782024-11-14T06:19:28.928ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2792024-11-14T06:19:28.929ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2802024-11-14T06:19:28.929ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2812024-11-14T06:19:28.930ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2822024-11-14T06:19:28.930ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2832024-11-14T06:19:28.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = b6d5490b-53a4-4ea2-940f-04c0cc167460 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
2842024-11-14T06:19:28.932ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852024-11-14T06:19:28.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = b6d5490b-53a4-4ea2-940f-04c0cc167460 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
2862024-11-14T06:19:28.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = b6d5490b-53a4-4ea2-940f-04c0cc167460 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
2872024-11-14T06:19:28.934ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = b6d5490b-53a4-4ea2-940f-04c0cc167460 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
2882024-11-14T06:19:28.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = b6d5490b-53a4-4ea2-940f-04c0cc167460 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
2892024-11-14T06:19:28.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = b6d5490b-53a4-4ea2-940f-04c0cc167460 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
2902024-11-14T06:19:28.935ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2912024-11-14T06:19:28.935ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2922024-11-14T06:19:28.935ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2932024-11-14T06:19:28.946ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2942024-11-14T06:19:28.946ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2952024-11-14T06:19:28.947ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2962024-11-14T06:19:28.947ZWARNnexus: Cannot look up rack: Object (of type ById(f391bffc-9f2b-4c87-85cd-2718afa7cb93)) not found: rack file = nexus/src/app/rack.rs:774
2972024-11-14T06:19:28.947ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982024-11-14T06:19:28.949ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992024-11-14T06:19:28.949ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3002024-11-14T06:19:28.950ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-11-14T06:19:28.950ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-11-14T06:19:28.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = b6d5490b-53a4-4ea2-940f-04c0cc167460 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
3032024-11-14T06:19:28.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = b6d5490b-53a4-4ea2-940f-04c0cc167460 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
3042024-11-14T06:19:28.991ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "f391bffc-9f2b-4c87-85cd-2718afa7cb93" error_message_internal = not found: rack with id "f391bffc-9f2b-4c87-85cd-2718afa7cb93" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 59921 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = b6d5490b-53a4-4ea2-940f-04c0cc167460 response_code = 404 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
3052024-11-14T06:19:28.996ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3062024-11-14T06:19:28.999ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3072024-11-14T06:19:28.999ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3082024-11-14T06:19:28.999ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3092024-11-14T06:19:29.100ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
3102024-11-14T06:19:29.100ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
3112024-11-14T06:19:29.100ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3122024-11-14T06:19:29.100ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3132024-11-14T06:19:29.108ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3142024-11-14T06:19:29.109ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3152024-11-14T06:19:29.110ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3162024-11-14T06:19:29.110ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3172024-11-14T06:19:29.112ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3182024-11-14T06:19:29.112ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192024-11-14T06:19:29.113ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3202024-11-14T06:19:29.113ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3212024-11-14T06:19:29.114ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3222024-11-14T06:19:29.114ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3232024-11-14T06:19:29.116ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3242024-11-14T06:19:29.119ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3252024-11-14T06:19:29.119ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3262024-11-14T06:19:29.119ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3272024-11-14T06:19:29.120ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3282024-11-14T06:19:29.121ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292024-11-14T06:19:29.129ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3302024-11-14T06:19:29.129ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3312024-11-14T06:19:29.130ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3322024-11-14T06:19:29.131ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3332024-11-14T06:19:29.140ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3342024-11-14T06:19:29.140ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3352024-11-14T06:19:29.141ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3362024-11-14T06:19:29.141ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3372024-11-14T06:19:29.142ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3382024-11-14T06:19:29.142ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3392024-11-14T06:19:29.143ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3402024-11-14T06:19:29.147ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3412024-11-14T06:19:29.147ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3422024-11-14T06:19:29.147ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3432024-11-14T06:19:29.152ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3442024-11-14T06:19:29.153ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3452024-11-14T06:19:29.154ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3462024-11-14T06:19:29.154ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3472024-11-14T06:19:29.155ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3482024-11-14T06:19:29.155ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3492024-11-14T06:19:29.156ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3502024-11-14T06:19:29.156ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3512024-11-14T06:19:29.158ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3522024-11-14T06:19:29.158ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3532024-11-14T06:19:29.159ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3542024-11-14T06:19:29.159ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3552024-11-14T06:19:29.160ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3562024-11-14T06:19:29.165ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ById(001de000-c470-4000-8000-000000000002) } result = Ok(())
3572024-11-14T06:19:29.165ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3582024-11-14T06:19:29.165ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3592024-11-14T06:19:29.166ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3602024-11-14T06:19:29.167ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3612024-11-14T06:19:29.168ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3622024-11-14T06:19:29.168ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3632024-11-14T06:19:29.170ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3642024-11-14T06:19:29.170ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3652024-11-14T06:19:29.171ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3662024-11-14T06:19:29.173ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3672024-11-14T06:19:29.197ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3682024-11-14T06:19:29.197ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3692024-11-14T06:19:29.330ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3702024-11-14T06:19:29.330ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3712024-11-14T06:19:29.334ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3722024-11-14T06:19:29.335ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3732024-11-14T06:19:29.336ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3742024-11-14T06:19:29.336ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3752024-11-14T06:19:29.337ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3762024-11-14T06:19:29.337ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3772024-11-14T06:19:29.338ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3782024-11-14T06:19:29.342ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3792024-11-14T06:19:29.342ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3802024-11-14T06:19:29.342ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3812024-11-14T06:19:29.349ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
3822024-11-14T06:19:29.349ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
3832024-11-14T06:19:29.349ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3842024-11-14T06:19:29.350ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3852024-11-14T06:19:29.350ZDEBGnexus (DataLoader): attempting to create silo users
3862024-11-14T06:19:29.350ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3872024-11-14T06:19:29.350ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3882024-11-14T06:19:29.358ZINFOnexus (DataLoader): created 0 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3892024-11-14T06:19:29.358ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3902024-11-14T06:19:29.358ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3912024-11-14T06:19:29.358ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3922024-11-14T06:19:29.360ZINFOnexus (DataLoader): created 0 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3932024-11-14T06:19:29.360ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3942024-11-14T06:19:29.360ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3952024-11-14T06:19:29.362ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3962024-11-14T06:19:29.362ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3972024-11-14T06:19:29.366ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3982024-11-14T06:19:29.366ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3992024-11-14T06:19:29.368ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4002024-11-14T06:19:29.369ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
4012024-11-14T06:19:29.369ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4022024-11-14T06:19:29.369ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4032024-11-14T06:19:29.378ZINFOnexus: populate complete file = nexus/src/app/mod.rs:555
4042024-11-14T06:19:29.378ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:564
4052024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4062024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4072024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4082024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4092024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4102024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4112024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4122024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4132024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4142024-11-14T06:19:29.386ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4152024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4162024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4172024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4182024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4192024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4202024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4212024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4222024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4232024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4242024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4252024-11-14T06:19:29.386ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4262024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4272024-11-14T06:19:29.386ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
4282024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4292024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4302024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4312024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4322024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 85.391\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4332024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 56.951\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4342024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4352024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4362024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4372024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4382024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4392024-11-14T06:19:29.386ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4402024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4412024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4422024-11-14T06:19:29.386ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4432024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4442024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4452024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4462024-11-14T06:19:29.387ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4472024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4482024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4492024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4502024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4512024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4522024-11-14T06:19:29.387ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4532024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4542024-11-14T06:19:29.387ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4552024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4562024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4572024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4582024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4592024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4602024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4612024-11-14T06:19:29.387ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:09:29.387337751 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4622024-11-14T06:19:29.387ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4632024-11-14T06:19:29.388ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4642024-11-14T06:19:29.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4652024-11-14T06:19:29.389ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4662024-11-14T06:19:29.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4672024-11-14T06:19:29.390ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4682024-11-14T06:19:29.390ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4692024-11-14T06:19:29.390ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4702024-11-14T06:19:29.390ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4712024-11-14T06:19:29.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4722024-11-14T06:19:29.390ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 4.057156ms iteration = 1 status = {"error":"no config nor servers"}
4732024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4742024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4752024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4762024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4772024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4782024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4792024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4802024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4812024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4822024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 842.176\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4832024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4842024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4852024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4862024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4872024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4882024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4892024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4902024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4912024-11-14T06:19:29.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4922024-11-14T06:19:29.391ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1025, tv_nsec: 954323901 } })
4932024-11-14T06:19:29.392ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4942024-11-14T06:19:29.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4952024-11-14T06:19:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4962024-11-14T06:19:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
4972024-11-14T06:19:29.395ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4982024-11-14T06:19:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4992024-11-14T06:19:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5002024-11-14T06:19:29.396ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
5012024-11-14T06:19:29.396ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 9.750142ms iteration = 1 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5022024-11-14T06:19:29.396ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
5032024-11-14T06:19:29.396ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5042024-11-14T06:19:29.396ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 2.62\u{b5}s iteration = 2 status = {"error":"no config"}
5052024-11-14T06:19:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5062024-11-14T06:19:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5072024-11-14T06:19:29.397ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1025, tv_nsec: 959772833 } })
5082024-11-14T06:19:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5092024-11-14T06:19:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5102024-11-14T06:19:29.397ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5112024-11-14T06:19:29.397ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
5122024-11-14T06:19:29.397ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 10.651778ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5132024-11-14T06:19:29.397ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
5142024-11-14T06:19:29.397ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5152024-11-14T06:19:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5162024-11-14T06:19:29.397ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 4.071\u{b5}s iteration = 2 status = {"error":"no config"}
5172024-11-14T06:19:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5182024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5192024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5202024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5212024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5222024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5232024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5242024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5252024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5262024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5272024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5282024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5292024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5302024-11-14T06:19:29.398ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:09:29.387337751 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5312024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5322024-11-14T06:19:29.398ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.170797ms iteration = 1 status = {"expiration":"2024-11-14T06:09:29.387337751Z","pruned":[]}
5332024-11-14T06:19:29.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5342024-11-14T06:19:29.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5352024-11-14T06:19:29.404ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5362024-11-14T06:19:29.404ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5372024-11-14T06:19:29.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5382024-11-14T06:19:29.406ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5392024-11-14T06:19:29.406ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5402024-11-14T06:19:29.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5412024-11-14T06:19:29.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5422024-11-14T06:19:29.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5432024-11-14T06:19:29.409ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5442024-11-14T06:19:29.411ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.106767ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5452024-11-14T06:19:29.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5462024-11-14T06:19:29.444ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1026, tv_nsec: 6765617 } })
5472024-11-14T06:19:29.444ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
5482024-11-14T06:19:29.445ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1026, tv_nsec: 8523130 } })
5492024-11-14T06:19:29.446ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
5502024-11-14T06:19:29.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5512024-11-14T06:19:29.463ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5522024-11-14T06:19:29.463ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 76.643486ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5532024-11-14T06:19:29.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5542024-11-14T06:19:29.467ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5552024-11-14T06:19:29.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5562024-11-14T06:19:29.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5572024-11-14T06:19:29.471ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5582024-11-14T06:19:29.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5592024-11-14T06:19:29.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602024-11-14T06:19:29.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5612024-11-14T06:19:29.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5622024-11-14T06:19:29.474ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5632024-11-14T06:19:29.474ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5642024-11-14T06:19:29.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5652024-11-14T06:19:29.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5662024-11-14T06:19:29.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672024-11-14T06:19:29.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5682024-11-14T06:19:29.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5692024-11-14T06:19:29.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5702024-11-14T06:19:29.494ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5712024-11-14T06:19:29.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5722024-11-14T06:19:29.496ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
5732024-11-14T06:19:29.496ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 110.411155ms iteration = 1 status = {"error":"rack not yet initialized: f391bffc-9f2b-4c87-85cd-2718afa7cb93"}
5742024-11-14T06:19:29.497ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 110.367124ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5752024-11-14T06:19:29.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762024-11-14T06:19:29.507ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5772024-11-14T06:19:29.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5782024-11-14T06:19:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5792024-11-14T06:19:29.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5802024-11-14T06:19:29.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5812024-11-14T06:19:29.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5822024-11-14T06:19:29.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5832024-11-14T06:19:29.515ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5842024-11-14T06:19:29.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5852024-11-14T06:19:29.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862024-11-14T06:19:29.516ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5872024-11-14T06:19:29.516ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 130.313175ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
5882024-11-14T06:19:29.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5892024-11-14T06:19:29.518ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5902024-11-14T06:19:29.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5912024-11-14T06:19:29.520ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5922024-11-14T06:19:29.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5932024-11-14T06:19:29.522ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 135.886239ms iteration = 1 status = {}
5942024-11-14T06:19:29.529ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 142.701166ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5952024-11-14T06:19:29.531ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
5962024-11-14T06:19:29.531ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5972024-11-14T06:19:29.531ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 144.401498ms iteration = 1 status = {"error":"inventory collection is None"}
5982024-11-14T06:19:29.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5992024-11-14T06:19:29.533ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6002024-11-14T06:19:29.536ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6012024-11-14T06:19:29.536ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6022024-11-14T06:19:29.536ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b73ab58-b45c-4967-ab75-d7c3e28d36d1", "content-length": "26", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6032024-11-14T06:19:29.537ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6042024-11-14T06:19:29.537ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
6052024-11-14T06:19:29.537ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 150.9938ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
6062024-11-14T06:19:29.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6072024-11-14T06:19:29.538ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6082024-11-14T06:19:29.538ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6092024-11-14T06:19:29.538ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6102024-11-14T06:19:29.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6112024-11-14T06:19:29.538ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6122024-11-14T06:19:29.538ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a5389d7-2cc5-45e6-89c1-bef3673decd4", "content-length": "26", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6132024-11-14T06:19:29.538ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6142024-11-14T06:19:29.539ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 152.952517ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
6152024-11-14T06:19:29.539ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6162024-11-14T06:19:29.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6172024-11-14T06:19:29.573ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6182024-11-14T06:19:29.573ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 187.135474ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6192024-11-14T06:19:29.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6202024-11-14T06:19:29.577ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6212024-11-14T06:19:29.577ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6222024-11-14T06:19:29.577ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 191.064736ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6232024-11-14T06:19:29.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6242024-11-14T06:19:29.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6252024-11-14T06:19:29.599ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
6262024-11-14T06:19:29.600ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1026, tv_nsec: 162978465 } })
6272024-11-14T06:19:29.604ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6282024-11-14T06:19:29.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6292024-11-14T06:19:29.607ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6302024-11-14T06:19:29.607ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6312024-11-14T06:19:29.607ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 220.86441ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6322024-11-14T06:19:29.610ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6332024-11-14T06:19:29.610ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 223.584622ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6342024-11-14T06:19:29.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6352024-11-14T06:19:29.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6362024-11-14T06:19:29.635ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6372024-11-14T06:19:29.635ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6382024-11-14T06:19:29.635ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6392024-11-14T06:19:29.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6402024-11-14T06:19:29.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 250.440962ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6412024-11-14T06:19:29.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 257.030304ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6422024-11-14T06:19:29.645ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6432024-11-14T06:19:29.645ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6442024-11-14T06:19:29.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6452024-11-14T06:19:29.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6462024-11-14T06:19:29.647ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6472024-11-14T06:19:29.647ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 260.254174ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6482024-11-14T06:19:29.649ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6492024-11-14T06:19:29.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6502024-11-14T06:19:29.687ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6512024-11-14T06:19:29.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6522024-11-14T06:19:29.691ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6532024-11-14T06:19:29.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6542024-11-14T06:19:29.697ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6552024-11-14T06:19:29.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6562024-11-14T06:19:29.710ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 323.502871ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6572024-11-14T06:19:29.711ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6582024-11-14T06:19:29.711ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6592024-11-14T06:19:29.711ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6602024-11-14T06:19:29.713ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "76a12578-b547-4e5f-89c2-a55214cf88eb", "content-length": "476", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6612024-11-14T06:19:29.713ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 326.779042ms iteration = 1 status = {}
6622024-11-14T06:19:29.714ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6632024-11-14T06:19:29.714ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6642024-11-14T06:19:29.714ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5c30162-8416-42b7-acc8-477879b345d0", "content-length": "734", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6652024-11-14T06:19:29.715ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6662024-11-14T06:19:29.715ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "05961044-598c-4485-8d11-edaf2b48477d", "content-length": "1", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6672024-11-14T06:19:29.715ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "580243b8-5236-4f5d-8a15-700c70606b24", "content-length": "111", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6682024-11-14T06:19:29.715ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6692024-11-14T06:19:29.715ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1265a957-67ad-4c4c-b3ee-d42b50a9797e", "content-length": "111", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6702024-11-14T06:19:29.716ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6712024-11-14T06:19:29.717ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6722024-11-14T06:19:29.717ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0e3b70e-ea29-424b-bea8-3f79df49bb04", "content-length": "167", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6732024-11-14T06:19:29.717ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6742024-11-14T06:19:29.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6752024-11-14T06:19:29.717ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "69eaade9-c29e-4731-bafa-dd060e032bf1", "content-length": "167", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6762024-11-14T06:19:29.717ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6772024-11-14T06:19:29.718ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1570c420-da1e-4e11-98d0-87e33b0f7971", "content-length": "175", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6782024-11-14T06:19:29.718ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6792024-11-14T06:19:29.718ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a262c696-4c45-481b-8e64-1b1cbc41a839", "content-length": "175", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6802024-11-14T06:19:29.718ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6812024-11-14T06:19:29.718ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "880504fb-7d23-4e3c-9691-c943e906cd48", "content-length": "702", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6822024-11-14T06:19:29.721ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6832024-11-14T06:19:29.721ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "99241278-6993-47be-b3fd-bf6a9e44a5d4", "content-length": "727", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6842024-11-14T06:19:29.722ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6852024-11-14T06:19:29.722ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1211a5a-cfdc-4121-a30c-98414300bcc2", "content-length": "729", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6862024-11-14T06:19:29.722ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6872024-11-14T06:19:29.723ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "83c1b9de-7fcd-454e-aa7a-6ef9278c9379", "content-length": "728", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6882024-11-14T06:19:29.723ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6892024-11-14T06:19:29.723ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a042a7a-495f-410d-9add-aa83e51a2509", "content-length": "722", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6902024-11-14T06:19:29.723ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6912024-11-14T06:19:29.723ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3511c6d-0d3d-4160-90ac-94ad4c5ad864", "content-length": "109", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6922024-11-14T06:19:29.723ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6932024-11-14T06:19:29.724ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc0d136b-57d2-41b6-9795-9ce257ae7408", "content-length": "109", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6942024-11-14T06:19:29.724ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6952024-11-14T06:19:29.724ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6302d76-f242-42ca-b022-d6d2ea88b6d3", "content-length": "169", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6962024-11-14T06:19:29.724ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6972024-11-14T06:19:29.725ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "05ac883b-7043-4a4a-81ea-45964d6b6f58", "content-length": "169", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
6982024-11-14T06:19:29.725ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
6992024-11-14T06:19:29.725ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0249f091-3b01-4d11-801e-7156716c76e5", "content-length": "178", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
7002024-11-14T06:19:29.725ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7012024-11-14T06:19:29.726ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e75dfec3-a3a6-4b6e-82dc-66fed51a24b0", "content-length": "178", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
7022024-11-14T06:19:29.726ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7032024-11-14T06:19:29.726ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cee7dda-511a-424b-aab9-7fd58275e22d", "content-length": "702", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
7042024-11-14T06:19:29.726ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7052024-11-14T06:19:29.726ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2fdb977-04ef-4f37-8b63-d87cbcb8002f", "content-length": "727", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
7062024-11-14T06:19:29.726ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7072024-11-14T06:19:29.727ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3c6e5ee-f097-4216-b6fc-ce6ea10e2b2a", "content-length": "729", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
7082024-11-14T06:19:29.727ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7092024-11-14T06:19:29.727ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "082e5451-e783-41da-828e-846bd92fc3dc", "content-length": "728", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
7102024-11-14T06:19:29.727ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7112024-11-14T06:19:29.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7122024-11-14T06:19:29.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 343.910331ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7132024-11-14T06:19:29.730ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7142024-11-14T06:19:29.732ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 345.539671ms iteration = 1 status = null
7152024-11-14T06:19:29.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7162024-11-14T06:19:29.733ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7172024-11-14T06:19:29.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7182024-11-14T06:19:29.738ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7192024-11-14T06:19:29.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7202024-11-14T06:19:29.741ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7212024-11-14T06:19:29.741ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7222024-11-14T06:19:29.741ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7232024-11-14T06:19:29.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7242024-11-14T06:19:29.741ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 355.037238ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7252024-11-14T06:19:29.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7262024-11-14T06:19:29.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7272024-11-14T06:19:29.763ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7282024-11-14T06:19:29.763ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7292024-11-14T06:19:29.767ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8282efd-8121-4799-9f9e-78270db13f73", "content-length": "312", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
7302024-11-14T06:19:29.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7312024-11-14T06:19:29.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7322024-11-14T06:19:29.774ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7332024-11-14T06:19:29.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7342024-11-14T06:19:29.777ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7352024-11-14T06:19:29.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7362024-11-14T06:19:29.785ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7372024-11-14T06:19:29.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7382024-11-14T06:19:29.790ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7392024-11-14T06:19:29.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7402024-11-14T06:19:29.802ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7412024-11-14T06:19:29.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7422024-11-14T06:19:29.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7432024-11-14T06:19:29.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7442024-11-14T06:19:29.806ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7452024-11-14T06:19:29.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7462024-11-14T06:19:29.809ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7472024-11-14T06:19:29.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7482024-11-14T06:19:29.810ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7492024-11-14T06:19:29.810ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 423.654986ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7502024-11-14T06:19:29.811ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7512024-11-14T06:19:29.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7522024-11-14T06:19:29.847ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7532024-11-14T06:19:29.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7542024-11-14T06:19:29.891ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7552024-11-14T06:19:29.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7562024-11-14T06:19:29.893ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7572024-11-14T06:19:29.893ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7582024-11-14T06:19:29.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7592024-11-14T06:19:29.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7602024-11-14T06:19:29.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7612024-11-14T06:19:29.895ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622024-11-14T06:19:29.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632024-11-14T06:19:29.896ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7642024-11-14T06:19:29.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7652024-11-14T06:19:29.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7662024-11-14T06:19:29.898ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "47206514-7193-497b-b33c-ce7ad9b909c6", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
7672024-11-14T06:19:29.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7682024-11-14T06:19:29.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7692024-11-14T06:19:29.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7702024-11-14T06:19:29.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7712024-11-14T06:19:29.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7722024-11-14T06:19:29.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7732024-11-14T06:19:29.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7742024-11-14T06:19:29.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7752024-11-14T06:19:29.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7762024-11-14T06:19:29.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7772024-11-14T06:19:29.902ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
7782024-11-14T06:19:29.902ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
7792024-11-14T06:19:29.902ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7802024-11-14T06:19:29.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7812024-11-14T06:19:29.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7822024-11-14T06:19:29.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7832024-11-14T06:19:29.906ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7842024-11-14T06:19:29.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7852024-11-14T06:19:29.908ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7862024-11-14T06:19:29.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7872024-11-14T06:19:29.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7882024-11-14T06:19:29.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7892024-11-14T06:19:29.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7902024-11-14T06:19:29.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7912024-11-14T06:19:29.911ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7922024-11-14T06:19:29.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7932024-11-14T06:19:29.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7942024-11-14T06:19:29.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7952024-11-14T06:19:29.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7962024-11-14T06:19:29.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7972024-11-14T06:19:29.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7982024-11-14T06:19:29.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7992024-11-14T06:19:29.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8002024-11-14T06:19:29.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8012024-11-14T06:19:29.916ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8022024-11-14T06:19:29.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8032024-11-14T06:19:29.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8042024-11-14T06:19:29.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8052024-11-14T06:19:29.920ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8062024-11-14T06:19:29.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8072024-11-14T06:19:29.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8082024-11-14T06:19:29.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8092024-11-14T06:19:29.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8102024-11-14T06:19:29.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8112024-11-14T06:19:29.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8122024-11-14T06:19:29.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
8132024-11-14T06:19:29.930ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8142024-11-14T06:19:29.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8152024-11-14T06:19:29.930ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8162024-11-14T06:19:29.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8172024-11-14T06:19:29.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8182024-11-14T06:19:29.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8192024-11-14T06:19:29.932ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8202024-11-14T06:19:29.933ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8212024-11-14T06:19:29.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8222024-11-14T06:19:29.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8232024-11-14T06:19:29.936ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8242024-11-14T06:19:29.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8252024-11-14T06:19:29.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8262024-11-14T06:19:29.941ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8272024-11-14T06:19:29.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8282024-11-14T06:19:29.943ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
8292024-11-14T06:19:29.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8302024-11-14T06:19:29.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8312024-11-14T06:19:29.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8322024-11-14T06:19:29.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8332024-11-14T06:19:29.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8342024-11-14T06:19:29.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8352024-11-14T06:19:29.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8362024-11-14T06:19:29.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8372024-11-14T06:19:29.950ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8382024-11-14T06:19:29.951ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8392024-11-14T06:19:29.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8402024-11-14T06:19:29.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8412024-11-14T06:19:29.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8422024-11-14T06:19:29.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8432024-11-14T06:19:29.953ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8442024-11-14T06:19:29.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8452024-11-14T06:19:29.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8462024-11-14T06:19:29.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8472024-11-14T06:19:29.954ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8482024-11-14T06:19:29.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8492024-11-14T06:19:29.956ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8502024-11-14T06:19:29.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8512024-11-14T06:19:29.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8522024-11-14T06:19:29.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8532024-11-14T06:19:29.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8542024-11-14T06:19:29.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8552024-11-14T06:19:29.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8562024-11-14T06:19:29.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8572024-11-14T06:19:29.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8582024-11-14T06:19:29.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8592024-11-14T06:19:29.961ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8602024-11-14T06:19:29.961ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8612024-11-14T06:19:29.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8622024-11-14T06:19:29.963ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8632024-11-14T06:19:29.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8642024-11-14T06:19:29.964ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8652024-11-14T06:19:29.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8662024-11-14T06:19:29.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8672024-11-14T06:19:29.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8682024-11-14T06:19:29.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8692024-11-14T06:19:29.966ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8702024-11-14T06:19:29.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8712024-11-14T06:19:29.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8722024-11-14T06:19:29.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8732024-11-14T06:19:29.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8742024-11-14T06:19:29.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8752024-11-14T06:19:29.969ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8762024-11-14T06:19:29.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8772024-11-14T06:19:29.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8782024-11-14T06:19:29.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8792024-11-14T06:19:29.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8802024-11-14T06:19:29.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8812024-11-14T06:19:30.004ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8822024-11-14T06:19:30.006ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "51ea4ba9-fa41-4dad-928c-27074fb4160c", "content-length": "691", "date": "Thu, 14 Nov 2024 06:19:30 GMT"} })
8832024-11-14T06:19:30.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8842024-11-14T06:19:30.006ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8852024-11-14T06:19:30.006ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8862024-11-14T06:19:30.006ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8872024-11-14T06:19:30.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8882024-11-14T06:19:30.007ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 620.960648ms iteration = 1 status = {}
8892024-11-14T06:19:30.008ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
8902024-11-14T06:19:30.008ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8912024-11-14T06:19:30.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8922024-11-14T06:19:30.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8932024-11-14T06:19:30.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8942024-11-14T06:19:30.009ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8952024-11-14T06:19:30.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8962024-11-14T06:19:30.011ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8972024-11-14T06:19:30.011ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8982024-11-14T06:19:30.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8992024-11-14T06:19:30.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
9002024-11-14T06:19:30.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9012024-11-14T06:19:30.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9022024-11-14T06:19:30.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9032024-11-14T06:19:30.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9042024-11-14T06:19:30.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9052024-11-14T06:19:30.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9062024-11-14T06:19:30.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9072024-11-14T06:19:30.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9082024-11-14T06:19:30.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9092024-11-14T06:19:30.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9102024-11-14T06:19:30.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9112024-11-14T06:19:30.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9122024-11-14T06:19:30.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9132024-11-14T06:19:30.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9142024-11-14T06:19:30.030ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
9152024-11-14T06:19:30.030ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
9162024-11-14T06:19:30.030ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
9172024-11-14T06:19:30.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9182024-11-14T06:19:30.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
9192024-11-14T06:19:30.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9202024-11-14T06:19:30.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9212024-11-14T06:19:30.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9222024-11-14T06:19:30.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9232024-11-14T06:19:30.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9242024-11-14T06:19:30.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9252024-11-14T06:19:30.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9262024-11-14T06:19:30.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9272024-11-14T06:19:30.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9282024-11-14T06:19:30.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9292024-11-14T06:19:30.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9302024-11-14T06:19:30.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9312024-11-14T06:19:30.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9322024-11-14T06:19:30.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9332024-11-14T06:19:30.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9342024-11-14T06:19:30.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000002, lookup_type: ByName("default") } result = Ok(())
9352024-11-14T06:19:30.064ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9362024-11-14T06:19:30.086ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "56f8e57b-f47d-4b0f-aa60-8558510a253d", "date": "Thu, 14 Nov 2024 06:19:30 GMT"} })
9372024-11-14T06:19:30.088ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 701.308903ms iteration = 1 status = {}
9382024-11-14T06:19:30.131ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
9392024-11-14T06:19:30.132ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
9402024-11-14T06:19:30.132ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
9412024-11-14T06:19:30.132ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 745.217971ms
9422024-11-14T06:19:30.132ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 745.228491ms iteration = 1 status = {}
9432024-11-14T06:19:30.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9442024-11-14T06:19:30.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9452024-11-14T06:19:30.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9462024-11-14T06:19:30.340ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9472024-11-14T06:19:30.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9482024-11-14T06:19:30.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9492024-11-14T06:19:30.368ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "9acf7107-f934-40f3-9400-5b14fb308d0e", "content-length": "30747", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} })
9502024-11-14T06:19:30.369ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9512024-11-14T06:19:30.369ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9522024-11-14T06:19:30.369ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
9532024-11-14T06:19:30.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9542024-11-14T06:19:30.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9552024-11-14T06:19:30.371ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9562024-11-14T06:19:30.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9572024-11-14T06:19:30.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9582024-11-14T06:19:30.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9592024-11-14T06:19:30.373ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9602024-11-14T06:19:30.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9612024-11-14T06:19:30.375ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9622024-11-14T06:19:30.375ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9632024-11-14T06:19:30.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9642024-11-14T06:19:30.377ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Rack { parent: Fleet, key: f391bffc-9f2b-4c87-85cd-2718afa7cb93, lookup_type: ById(f391bffc-9f2b-4c87-85cd-2718afa7cb93) } result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9652024-11-14T06:19:30.377ZDEBGnexus (dropshot_internal): updating rack subnet for rack f391bffc-9f2b-4c87-85cd-2718afa7cb93 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9662024-11-14T06:19:30.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9672024-11-14T06:19:30.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9682024-11-14T06:19:30.381ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9692024-11-14T06:19:30.411ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9702024-11-14T06:19:30.413ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "4be9fd21-0ae2-4522-b5fe-eaa6c854f635", "content-length": "24", "date": "Thu, 14 Nov 2024 06:19:29 GMT"} }) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9712024-11-14T06:19:30.415ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9722024-11-14T06:19:30.415ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9732024-11-14T06:19:30.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9742024-11-14T06:19:30.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9752024-11-14T06:19:30.440ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9762024-11-14T06:19:30.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9772024-11-14T06:19:30.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9782024-11-14T06:19:30.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9792024-11-14T06:19:30.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9802024-11-14T06:19:30.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9812024-11-14T06:19:30.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9822024-11-14T06:19:30.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9832024-11-14T06:19:30.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9842024-11-14T06:19:30.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9852024-11-14T06:19:30.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9862024-11-14T06:19:30.689ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9872024-11-14T06:19:30.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9882024-11-14T06:19:30.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9892024-11-14T06:19:30.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9902024-11-14T06:19:30.697ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9912024-11-14T06:19:30.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9922024-11-14T06:19:30.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9932024-11-14T06:19:30.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9942024-11-14T06:19:30.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9952024-11-14T06:19:30.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9962024-11-14T06:19:30.703ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = IpPool { parent: Fleet, key: b106b2df-5c5a-4b66-a93c-6645de455c39, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9972024-11-14T06:19:30.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9982024-11-14T06:19:30.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
9992024-11-14T06:19:30.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10002024-11-14T06:19:30.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10012024-11-14T06:19:30.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10022024-11-14T06:19:30.707ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = IpPool { parent: Fleet, key: b106b2df-5c5a-4b66-a93c-6645de455c39, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10032024-11-14T06:19:30.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10042024-11-14T06:19:30.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10052024-11-14T06:19:30.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10062024-11-14T06:19:30.730ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = BlueprintConfig result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10072024-11-14T06:19:30.872ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 1d98d624-72d4-4466-8fe7-990461a3f886 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10082024-11-14T06:19:30.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10092024-11-14T06:19:30.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10102024-11-14T06:19:30.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10112024-11-14T06:19:30.876ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = BlueprintConfig result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10122024-11-14T06:19:30.889ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10132024-11-14T06:19:30.889ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10142024-11-14T06:19:30.889ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10152024-11-14T06:19:30.889ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10162024-11-14T06:19:30.889ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10172024-11-14T06:19:30.889ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10182024-11-14T06:19:30.889ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10192024-11-14T06:19:30.889ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10202024-11-14T06:19:30.895ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 0d34574e-3a0d-49bb-b1f1-342637aa0810 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
10212024-11-14T06:19:30.895ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 0d34574e-3a0d-49bb-b1f1-342637aa0810 time_started = 2024-11-14 06:19:29.708956 UTC
10222024-11-14T06:19:30.895ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.508872755s iteration = 1 status = {"collection_id":"0d34574e-3a0d-49bb-b1f1-342637aa0810","time_done":"2024-11-14 06:19:30.369739 UTC","time_started":"2024-11-14 06:19:29.708956 UTC"}
10232024-11-14T06:19:30.895ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
10242024-11-14T06:19:30.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10252024-11-14T06:19:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10262024-11-14T06:19:30.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10272024-11-14T06:19:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10282024-11-14T06:19:30.898ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10292024-11-14T06:19:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10302024-11-14T06:19:30.900ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
10312024-11-14T06:19:30.900ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 4.87676ms iteration = 2 status = {"error":"rack not yet initialized: f391bffc-9f2b-4c87-85cd-2718afa7cb93"}
10322024-11-14T06:19:30.948ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10332024-11-14T06:19:30.948ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10342024-11-14T06:19:30.949ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10352024-11-14T06:19:30.949ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10362024-11-14T06:19:30.951ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10372024-11-14T06:19:30.953ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f391bffc-9f2b-4c87-85cd-2718afa7cb93, lookup_type: ById(f391bffc-9f2b-4c87-85cd-2718afa7cb93) } result = Ok(())
10382024-11-14T06:19:30.953ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, time_created: 2024-11-14T06:19:29.341799Z, time_modified: 2024-11-14T06:19:29.341799Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
10392024-11-14T06:19:30.978ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10402024-11-14T06:19:30.998ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10412024-11-14T06:19:31.018ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10422024-11-14T06:19:31.056ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10432024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10442024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10452024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10462024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10472024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10482024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10492024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10502024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10512024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10522024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10532024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10542024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10552024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10562024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10572024-11-14T06:19:31.076ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10582024-11-14T06:19:31.097ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10592024-11-14T06:19:31.097ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10602024-11-14T06:19:31.097ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 7200f878-0b79-471d-943f-a7456d03aa99, time_created: 2024-11-14T06:19:30.340380800Z, time_modified: 2024-11-14T06:19:30.340380800Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10612024-11-14T06:19:31.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10622024-11-14T06:19:31.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10632024-11-14T06:19:31.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10642024-11-14T06:19:31.100ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10652024-11-14T06:19:31.133ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 0f7078ab-9534-479e-97fb-5d92aff23217, time_created: 2024-11-14T06:19:30.340381390Z, time_modified: 2024-11-14T06:19:30.340381390Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2", variant: U2, sled_id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10662024-11-14T06:19:31.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10672024-11-14T06:19:31.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10682024-11-14T06:19:31.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10692024-11-14T06:19:31.136ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10702024-11-14T06:19:31.140ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: ac70c917-7338-46fc-bc5a-31bb62e95641, time_created: 2024-11-14T06:19:30.340381480Z, time_modified: 2024-11-14T06:19:30.340381480Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2", variant: U2, sled_id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10712024-11-14T06:19:31.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10722024-11-14T06:19:31.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10732024-11-14T06:19:31.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10742024-11-14T06:19:31.143ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10752024-11-14T06:19:31.147ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 675d4e3a-cf28-4692-8edd-d4264488bce5, time_created: 2024-11-14T06:19:30.340381600Z, time_modified: 2024-11-14T06:19:30.340381600Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2", variant: U2, sled_id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10762024-11-14T06:19:31.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10772024-11-14T06:19:31.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10782024-11-14T06:19:31.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10792024-11-14T06:19:31.150ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10802024-11-14T06:19:31.154ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: c937aad7-4c5e-4cda-b007-5e8d662d1096, time_created: 2024-11-14T06:19:30.340381670Z, time_modified: 2024-11-14T06:19:30.340381670Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2", variant: U2, sled_id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10812024-11-14T06:19:31.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10822024-11-14T06:19:31.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10832024-11-14T06:19:31.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10842024-11-14T06:19:31.158ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10852024-11-14T06:19:31.161ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 0ad7d472-4fd4-4059-9d34-8b341fa41001, time_created: 2024-11-14T06:19:30.340381750Z, time_modified: 2024-11-14T06:19:30.340381750Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2", variant: U2, sled_id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10862024-11-14T06:19:31.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10872024-11-14T06:19:31.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10882024-11-14T06:19:31.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10892024-11-14T06:19:31.165ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10902024-11-14T06:19:31.170ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: d3855842-9941-4424-bd49-80c7a63994d6, time_created: 2024-11-14T06:19:30.340381830Z, time_modified: 2024-11-14T06:19:30.340381830Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2", variant: U2, sled_id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10912024-11-14T06:19:31.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10922024-11-14T06:19:31.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10932024-11-14T06:19:31.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10942024-11-14T06:19:31.174ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10952024-11-14T06:19:31.181ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 461c345f-3598-428d-a0e1-53e361701236, time_created: 2024-11-14T06:19:30.340381910Z, time_modified: 2024-11-14T06:19:30.340381910Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2", variant: U2, sled_id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10962024-11-14T06:19:31.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10972024-11-14T06:19:31.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10982024-11-14T06:19:31.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
10992024-11-14T06:19:31.186ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11002024-11-14T06:19:31.192ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 0f1d1d8b-804f-4d02-b11c-e2a17c07020a, time_created: 2024-11-14T06:19:30.340381990Z, time_modified: 2024-11-14T06:19:30.340381990Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2", variant: U2, sled_id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11012024-11-14T06:19:31.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11022024-11-14T06:19:31.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11032024-11-14T06:19:31.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11042024-11-14T06:19:31.195ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11052024-11-14T06:19:31.199ZINFOnexus (dropshot_internal): Inserted physical disks actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:823 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11062024-11-14T06:19:31.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11072024-11-14T06:19:31.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11082024-11-14T06:19:31.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11092024-11-14T06:19:31.202ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11102024-11-14T06:19:31.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11112024-11-14T06:19:31.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11122024-11-14T06:19:31.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11132024-11-14T06:19:31.218ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11142024-11-14T06:19:31.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11152024-11-14T06:19:31.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11162024-11-14T06:19:31.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11172024-11-14T06:19:31.225ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11182024-11-14T06:19:31.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11192024-11-14T06:19:31.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11202024-11-14T06:19:31.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11212024-11-14T06:19:31.231ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11222024-11-14T06:19:31.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11232024-11-14T06:19:31.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11242024-11-14T06:19:31.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11252024-11-14T06:19:31.238ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11262024-11-14T06:19:31.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11272024-11-14T06:19:31.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11282024-11-14T06:19:31.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11292024-11-14T06:19:31.246ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11302024-11-14T06:19:31.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11312024-11-14T06:19:31.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11322024-11-14T06:19:31.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11332024-11-14T06:19:31.253ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11342024-11-14T06:19:31.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11352024-11-14T06:19:31.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11362024-11-14T06:19:31.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11372024-11-14T06:19:31.260ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11382024-11-14T06:19:31.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11392024-11-14T06:19:31.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11402024-11-14T06:19:31.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11412024-11-14T06:19:31.266ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11422024-11-14T06:19:31.270ZINFOnexus (dropshot_internal): Inserted zpools actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:835 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11432024-11-14T06:19:31.537ZINFOnexus (dropshot_internal): Inserted datasets actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:865 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11442024-11-14T06:19:31.566ZINFOnexus (dropshot_internal): Populated DNS tables for internal DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:876 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11452024-11-14T06:19:31.569ZINFOnexus (dropshot_internal): Populated DNS tables for external DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:885 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11462024-11-14T06:19:31.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11472024-11-14T06:19:31.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11482024-11-14T06:19:31.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11492024-11-14T06:19:31.572ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11502024-11-14T06:19:31.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11512024-11-14T06:19:31.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11522024-11-14T06:19:31.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11532024-11-14T06:19:31.575ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11542024-11-14T06:19:31.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11552024-11-14T06:19:31.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11562024-11-14T06:19:31.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11572024-11-14T06:19:31.605ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = DnsConfig result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11582024-11-14T06:19:31.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11592024-11-14T06:19:31.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11602024-11-14T06:19:31.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11612024-11-14T06:19:31.609ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = DnsConfig result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11622024-11-14T06:19:31.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11632024-11-14T06:19:31.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11642024-11-14T06:19:31.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11652024-11-14T06:19:31.615ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = DnsConfig result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11662024-11-14T06:19:31.626ZINFOnexus (dropshot_internal): Created recovery silo actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11672024-11-14T06:19:31.633ZINFOnexus (dropshot_internal): Created recovery user actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:467 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11682024-11-14T06:19:31.638ZINFOnexus (dropshot_internal): Created recovery user's password actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:481 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11692024-11-14T06:19:31.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11702024-11-14T06:19:31.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11712024-11-14T06:19:31.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11722024-11-14T06:19:31.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11732024-11-14T06:19:31.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11742024-11-14T06:19:31.642ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11752024-11-14T06:19:31.642ZDEBGnexus (dropshot_internal): Generated role assignment queries actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11762024-11-14T06:19:31.647ZINFOnexus (dropshot_internal): Granted Silo privileges actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11772024-11-14T06:19:31.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11782024-11-14T06:19:31.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11792024-11-14T06:19:31.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11802024-11-14T06:19:31.649ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11812024-11-14T06:19:31.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11822024-11-14T06:19:31.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11832024-11-14T06:19:31.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11842024-11-14T06:19:31.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11852024-11-14T06:19:31.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11862024-11-14T06:19:31.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11872024-11-14T06:19:31.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11882024-11-14T06:19:31.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11892024-11-14T06:19:31.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11902024-11-14T06:19:31.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11912024-11-14T06:19:31.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11922024-11-14T06:19:31.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11932024-11-14T06:19:31.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11942024-11-14T06:19:31.676ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11952024-11-14T06:19:31.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11962024-11-14T06:19:31.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11972024-11-14T06:19:31.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11982024-11-14T06:19:31.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
11992024-11-14T06:19:31.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12002024-11-14T06:19:31.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12012024-11-14T06:19:31.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12022024-11-14T06:19:31.683ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12032024-11-14T06:19:31.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12042024-11-14T06:19:31.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12052024-11-14T06:19:31.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12062024-11-14T06:19:31.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12072024-11-14T06:19:31.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12082024-11-14T06:19:31.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12092024-11-14T06:19:31.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12102024-11-14T06:19:31.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12112024-11-14T06:19:31.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12122024-11-14T06:19:31.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12132024-11-14T06:19:31.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12142024-11-14T06:19:31.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12152024-11-14T06:19:31.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12162024-11-14T06:19:31.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12172024-11-14T06:19:31.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12182024-11-14T06:19:31.730ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12192024-11-14T06:19:31.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12202024-11-14T06:19:31.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12212024-11-14T06:19:31.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12222024-11-14T06:19:31.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12232024-11-14T06:19:31.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12242024-11-14T06:19:31.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12252024-11-14T06:19:31.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12262024-11-14T06:19:31.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12272024-11-14T06:19:31.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12282024-11-14T06:19:31.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12292024-11-14T06:19:31.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12302024-11-14T06:19:31.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12312024-11-14T06:19:31.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12322024-11-14T06:19:31.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12332024-11-14T06:19:31.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12342024-11-14T06:19:31.745ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12352024-11-14T06:19:31.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12362024-11-14T06:19:31.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12372024-11-14T06:19:31.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12382024-11-14T06:19:31.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12392024-11-14T06:19:31.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12402024-11-14T06:19:31.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12412024-11-14T06:19:31.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12422024-11-14T06:19:31.752ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12432024-11-14T06:19:31.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12442024-11-14T06:19:31.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12452024-11-14T06:19:31.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12462024-11-14T06:19:31.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12472024-11-14T06:19:31.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12482024-11-14T06:19:31.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12492024-11-14T06:19:31.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12502024-11-14T06:19:31.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12512024-11-14T06:19:31.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12522024-11-14T06:19:31.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12532024-11-14T06:19:31.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12542024-11-14T06:19:31.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12552024-11-14T06:19:31.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12562024-11-14T06:19:31.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12572024-11-14T06:19:31.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12582024-11-14T06:19:31.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12592024-11-14T06:19:31.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12602024-11-14T06:19:31.770ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12612024-11-14T06:19:31.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12622024-11-14T06:19:31.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12632024-11-14T06:19:31.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12642024-11-14T06:19:31.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12652024-11-14T06:19:31.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12662024-11-14T06:19:31.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12672024-11-14T06:19:31.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12682024-11-14T06:19:31.778ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12692024-11-14T06:19:31.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12702024-11-14T06:19:31.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12712024-11-14T06:19:31.782ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
12722024-11-14T06:19:31.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12732024-11-14T06:19:31.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12742024-11-14T06:19:31.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12752024-11-14T06:19:31.785ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Fleet result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12762024-11-14T06:19:31.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 roles = RoleSet { roles: {} } uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12772024-11-14T06:19:31.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 resource = Database result = Ok(()) uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
12782024-11-14T06:19:31.794ZDEBGnexus: Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
12792024-11-14T06:19:31.795ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
12802024-11-14T06:19:31.795ZDEBGnexus: resolved 2 rules for sleds
12812024-11-14T06:19:31.847ZDEBGnexus: resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, time_created: 2024-11-14T06:19:28.463914Z, time_modified: 2024-11-14T06:19:28.463914Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
12822024-11-14T06:19:31.847ZDEBGnexus: sending firewall rules to sled agents
12832024-11-14T06:19:31.847ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12842024-11-14T06:19:31.847ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12852024-11-14T06:19:31.849ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12862024-11-14T06:19:31.849ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12872024-11-14T06:19:31.851ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
12882024-11-14T06:19:31.852ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
12892024-11-14T06:19:31.882ZDEBGnexus: client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
12902024-11-14T06:19:31.892ZDEBGnexus: client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "4856aacf-58ee-4717-a086-facfd24b5bd9", "date": "Thu, 14 Nov 2024 06:19:31 GMT"} })
12912024-11-14T06:19:31.894ZINFOnexus: updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
12922024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
12932024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
12942024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
12952024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12962024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
12972024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12982024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
12992024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13002024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13012024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
13022024-11-14T06:19:31.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1558967 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:57091 req_id = 4b3c5de9-f672-4c31-9533-6a22e741efb7 response_code = 204 uri = /racks/f391bffc-9f2b-4c87-85cd-2718afa7cb93/initialization-complete
13032024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13042024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
13052024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13062024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13072024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13082024-11-14T06:19:31.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13092024-11-14T06:19:31.894ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1028, tv_nsec: 457567934 } })
13102024-11-14T06:19:31.894ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1028, tv_nsec: 457726237 } })
13112024-11-14T06:19:31.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13122024-11-14T06:19:31.895ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
13132024-11-14T06:19:31.895ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 953.788\u{b5}s iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
13142024-11-14T06:19:31.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13152024-11-14T06:19:31.895ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
13162024-11-14T06:19:31.895ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.138571ms iteration = 2 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
13172024-11-14T06:19:31.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13182024-11-14T06:19:31.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13192024-11-14T06:19:31.896ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13202024-11-14T06:19:31.897ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13212024-11-14T06:19:31.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13222024-11-14T06:19:31.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13232024-11-14T06:19:31.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13242024-11-14T06:19:31.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13252024-11-14T06:19:31.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13262024-11-14T06:19:31.900ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
13272024-11-14T06:19:31.900ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13282024-11-14T06:19:31.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13292024-11-14T06:19:31.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13302024-11-14T06:19:31.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13312024-11-14T06:19:31.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13322024-11-14T06:19:31.902ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(2d520985-022b-4917-9072-41a939ea81a0, 0), (0d34574e-3a0d-49bb-b1f1-342637aa0810, 0), (56a09639-464f-48bf-b120-9ccdf0987326, 0), (feba1a29-4c10-4492-a815-c97085a474b4, 0)] collection_id = 2d520985-022b-4917-9072-41a939ea81a0
13332024-11-14T06:19:31.902ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13342024-11-14T06:19:31.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13352024-11-14T06:19:31.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13362024-11-14T06:19:31.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13372024-11-14T06:19:31.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13382024-11-14T06:19:31.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13392024-11-14T06:19:31.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13402024-11-14T06:19:31.936ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
13412024-11-14T06:19:31.936ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
13422024-11-14T06:19:31.936ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
13432024-11-14T06:19:31.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13442024-11-14T06:19:31.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13452024-11-14T06:19:31.938ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13462024-11-14T06:19:31.940ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
13472024-11-14T06:19:31.940ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
13482024-11-14T06:19:31.940ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
13492024-11-14T06:19:31.940ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13502024-11-14T06:19:31.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13512024-11-14T06:19:31.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13522024-11-14T06:19:31.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13532024-11-14T06:19:31.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13542024-11-14T06:19:31.942ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13552024-11-14T06:19:31.944ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13562024-11-14T06:19:31.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13572024-11-14T06:19:31.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13582024-11-14T06:19:31.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13592024-11-14T06:19:31.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13602024-11-14T06:19:31.946ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13612024-11-14T06:19:31.947ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13622024-11-14T06:19:31.947ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
13632024-11-14T06:19:31.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13642024-11-14T06:19:31.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13652024-11-14T06:19:31.947ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13662024-11-14T06:19:31.947ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13672024-11-14T06:19:31.947ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
13682024-11-14T06:19:31.947ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
13692024-11-14T06:19:31.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13702024-11-14T06:19:31.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13712024-11-14T06:19:31.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13722024-11-14T06:19:31.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13732024-11-14T06:19:31.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13742024-11-14T06:19:31.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13752024-11-14T06:19:31.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13762024-11-14T06:19:31.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13772024-11-14T06:19:31.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13782024-11-14T06:19:31.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13792024-11-14T06:19:31.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13802024-11-14T06:19:31.955ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
13812024-11-14T06:19:31.955ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 61.24889ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13822024-11-14T06:19:31.966ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
13832024-11-14T06:19:31.966ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13842024-11-14T06:19:31.966ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
13852024-11-14T06:19:31.966ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 72.223194ms iteration = 2 status = {"generation":2}
13862024-11-14T06:19:31.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
13872024-11-14T06:19:31.966ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
13882024-11-14T06:19:31.966ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13892024-11-14T06:19:31.966ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
13902024-11-14T06:19:31.966ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 72.665843ms iteration = 2 status = {"generation":1}
13912024-11-14T06:19:31.966ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
13922024-11-14T06:19:32.025ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13932024-11-14T06:19:32.027ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
13942024-11-14T06:19:32.035ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 2d520985-022b-4917-9072-41a939ea81a0 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
13952024-11-14T06:19:32.035ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13962024-11-14T06:19:32.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13972024-11-14T06:19:32.039ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(0d34574e-3a0d-49bb-b1f1-342637aa0810, 0), (56a09639-464f-48bf-b120-9ccdf0987326, 0), (feba1a29-4c10-4492-a815-c97085a474b4, 0)]
13982024-11-14T06:19:32.039ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1028, tv_nsec: 602279268 } })
13992024-11-14T06:19:32.110ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
14002024-11-14T06:19:32.115ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
14012024-11-14T06:19:32.126ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
14022024-11-14T06:19:32.126ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
14032024-11-14T06:19:32.126ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
14042024-11-14T06:19:32.126ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "221d82f9-376e-49f5-a158-7c40bdb0c3ea", "content-length": "476", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14052024-11-14T06:19:32.126ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
14062024-11-14T06:19:32.127ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c0674fc-1e85-4ebc-91bf-7ace8b371d2a", "content-length": "734", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14072024-11-14T06:19:32.127ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
14082024-11-14T06:19:32.127ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cddbf997-b9c2-4d86-8f34-79e1b06a2446", "content-length": "111", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14092024-11-14T06:19:32.127ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
14102024-11-14T06:19:32.128ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5785daa6-e0a7-46c0-a5c6-22c1a514a355", "content-length": "111", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14112024-11-14T06:19:32.128ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
14122024-11-14T06:19:32.128ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "50abce9b-f60c-4bbc-85fa-8e1806fe3fae", "content-length": "167", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14132024-11-14T06:19:32.128ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
14142024-11-14T06:19:32.128ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9aa1eaa-29e6-4810-9111-ecdef44d87fc", "content-length": "167", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14152024-11-14T06:19:32.128ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
14162024-11-14T06:19:32.128ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf8ef814-bfa5-4692-93e2-f250f5481a68", "content-length": "175", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14172024-11-14T06:19:32.128ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
14182024-11-14T06:19:32.129ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "773cc77c-2e4d-4ace-b187-bc4d30c72b69", "content-length": "175", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14192024-11-14T06:19:32.129ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
14202024-11-14T06:19:32.129ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "289ad3bf-cce3-4234-9944-3d2673e081f3", "content-length": "702", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14212024-11-14T06:19:32.129ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
14222024-11-14T06:19:32.129ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb17fefd-3b6d-4622-a0dd-5ad11aa878fc", "content-length": "727", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14232024-11-14T06:19:32.129ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
14242024-11-14T06:19:32.129ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a8f8ee6-be9e-43ef-b9a3-6c9f620a95ba", "content-length": "729", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14252024-11-14T06:19:32.129ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
14262024-11-14T06:19:32.129ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9acfa0a-5cf4-460d-8324-89b5ca6a8a9a", "content-length": "728", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14272024-11-14T06:19:32.129ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
14282024-11-14T06:19:32.130ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2677291c-7ac1-452e-8f5d-f47af0363933", "content-length": "722", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14292024-11-14T06:19:32.130ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
14302024-11-14T06:19:32.130ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "82673100-78cf-4261-a741-61bb18771888", "content-length": "109", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14312024-11-14T06:19:32.130ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
14322024-11-14T06:19:32.130ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "72e46096-0351-4119-8cce-48f1f4bcdb6b", "content-length": "109", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14332024-11-14T06:19:32.130ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
14342024-11-14T06:19:32.130ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f756114-fe01-4de7-ad1c-59a5f0bc2d4b", "content-length": "169", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14352024-11-14T06:19:32.130ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
14362024-11-14T06:19:32.131ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f34cc00f-b494-44ea-ac96-511950035cad", "content-length": "169", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14372024-11-14T06:19:32.131ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
14382024-11-14T06:19:32.131ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae62ee5d-4563-484a-ba7d-b1b96d7afb51", "content-length": "178", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14392024-11-14T06:19:32.131ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
14402024-11-14T06:19:32.131ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "649cf0af-050d-4fc6-a0fc-99b7d1bfb560", "content-length": "178", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14412024-11-14T06:19:32.131ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
14422024-11-14T06:19:32.131ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "44fc3cf8-8e9f-49a9-8dd4-e25db0d441dc", "content-length": "702", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14432024-11-14T06:19:32.131ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
14442024-11-14T06:19:32.132ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f123f20-2473-499d-bcb5-d68768019f65", "content-length": "727", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14452024-11-14T06:19:32.132ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
14462024-11-14T06:19:32.132ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "25e55772-ff4b-4385-bfa0-5e2bd2a3a6f2", "content-length": "729", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14472024-11-14T06:19:32.132ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
14482024-11-14T06:19:32.132ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3fcb22f-0e8c-46b0-9f06-46ea0df24437", "content-length": "728", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14492024-11-14T06:19:32.132ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14502024-11-14T06:19:32.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14512024-11-14T06:19:32.134ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14522024-11-14T06:19:32.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
14532024-11-14T06:19:32.136ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14542024-11-14T06:19:32.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14552024-11-14T06:19:32.137ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14562024-11-14T06:19:32.138ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8d117f88-8bfe-49c1-b905-a0896067f89f", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14572024-11-14T06:19:32.138ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14582024-11-14T06:19:32.139ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
14592024-11-14T06:19:32.139ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14602024-11-14T06:19:32.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14612024-11-14T06:19:32.142ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1884e580-9048-4312-ac0d-736782f42b38", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14622024-11-14T06:19:32.142ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14632024-11-14T06:19:32.143ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14642024-11-14T06:19:32.143ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 177.370781ms iteration = 3 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
14652024-11-14T06:19:32.152ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
14662024-11-14T06:19:32.172ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "049e7db6-7882-429c-82c1-ccc4f09b25e2", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
14672024-11-14T06:19:32.172ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
14682024-11-14T06:19:32.177ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7071ec12-316c-4349-8fd1-d91e576e5310", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
14692024-11-14T06:19:32.177ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
14702024-11-14T06:19:32.178ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "501684f5-e547-43e9-bf47-6420764c3651", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
14712024-11-14T06:19:32.178ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
14722024-11-14T06:19:32.180ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
14732024-11-14T06:19:32.180ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 213.27481ms iteration = 3 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
14742024-11-14T06:19:32.227ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
14752024-11-14T06:19:32.227ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
14762024-11-14T06:19:32.438ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0b10e5d-e5b2-4a8e-a362-e540d7937e22", "content-length": "30747", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
14772024-11-14T06:19:32.439ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
14782024-11-14T06:19:32.439ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
14792024-11-14T06:19:32.439ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
14802024-11-14T06:19:32.441ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14812024-11-14T06:19:32.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14822024-11-14T06:19:32.444ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14832024-11-14T06:19:32.445ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
14842024-11-14T06:19:32.446ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14852024-11-14T06:19:32.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14862024-11-14T06:19:32.509ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = b1d70c97-efc9-4fbd-a649-842759ce153f file = nexus/db-queries/src/db/datastore/inventory.rs:1000
14872024-11-14T06:19:32.509ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = b1d70c97-efc9-4fbd-a649-842759ce153f time_started = 2024-11-14 06:19:32.126491 UTC
14882024-11-14T06:19:32.509ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 614.887266ms iteration = 2 status = {"collection_id":"b1d70c97-efc9-4fbd-a649-842759ce153f","time_done":"2024-11-14 06:19:32.439929 UTC","time_started":"2024-11-14 06:19:32.126491 UTC"}
14892024-11-14T06:19:32.509ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
14902024-11-14T06:19:32.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14912024-11-14T06:19:32.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14922024-11-14T06:19:32.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14932024-11-14T06:19:32.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14942024-11-14T06:19:32.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14952024-11-14T06:19:32.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14962024-11-14T06:19:32.514ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14972024-11-14T06:19:32.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14982024-11-14T06:19:32.516ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14992024-11-14T06:19:32.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15002024-11-14T06:19:32.517ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15012024-11-14T06:19:32.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15022024-11-14T06:19:32.566ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 57.816356ms iteration = 3 status = {"physical_disks_added":0}
15032024-11-14T06:19:32.955ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15042024-11-14T06:19:32.955ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15052024-11-14T06:19:32.957ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15062024-11-14T06:19:32.957ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15072024-11-14T06:19:32.959ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15082024-11-14T06:19:32.961ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f391bffc-9f2b-4c87-85cd-2718afa7cb93, lookup_type: ById(f391bffc-9f2b-4c87-85cd-2718afa7cb93) } result = Ok(())
15092024-11-14T06:19:32.961ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
15102024-11-14T06:19:32.961ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15112024-11-14T06:19:32.961ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15122024-11-14T06:19:32.963ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15132024-11-14T06:19:32.963ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15142024-11-14T06:19:32.964ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15152024-11-14T06:19:32.964ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15162024-11-14T06:19:32.966ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15172024-11-14T06:19:32.966ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15182024-11-14T06:19:32.968ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15192024-11-14T06:19:32.968ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15202024-11-14T06:19:32.969ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15212024-11-14T06:19:32.969ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15222024-11-14T06:19:32.970ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15232024-11-14T06:19:32.973ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15242024-11-14T06:19:32.973ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15252024-11-14T06:19:32.973ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15262024-11-14T06:19:32.975ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15272024-11-14T06:19:32.975ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15282024-11-14T06:19:32.976ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15292024-11-14T06:19:32.976ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15302024-11-14T06:19:32.977ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15312024-11-14T06:19:32.980ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15322024-11-14T06:19:32.980ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15332024-11-14T06:19:32.980ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15342024-11-14T06:19:32.982ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15352024-11-14T06:19:32.983ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15362024-11-14T06:19:32.983ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15372024-11-14T06:19:32.984ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15382024-11-14T06:19:32.985ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15392024-11-14T06:19:32.985ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15402024-11-14T06:19:32.986ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15412024-11-14T06:19:32.986ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15422024-11-14T06:19:32.987ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15432024-11-14T06:19:32.987ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15442024-11-14T06:19:32.989ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15452024-11-14T06:19:32.989ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15462024-11-14T06:19:32.989ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15472024-11-14T06:19:32.992ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
15482024-11-14T06:19:32.992ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15492024-11-14T06:19:32.993ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15502024-11-14T06:19:32.994ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15512024-11-14T06:19:32.994ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15522024-11-14T06:19:32.995ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15532024-11-14T06:19:32.995ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15542024-11-14T06:19:32.997ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15552024-11-14T06:19:32.997ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15562024-11-14T06:19:32.999ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15572024-11-14T06:19:32.999ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15582024-11-14T06:19:33.000ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15592024-11-14T06:19:33.000ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15602024-11-14T06:19:33.001ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15612024-11-14T06:19:33.002ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15622024-11-14T06:19:33.003ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15632024-11-14T06:19:33.006ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15642024-11-14T06:19:33.006ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15652024-11-14T06:19:33.006ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15662024-11-14T06:19:33.008ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15672024-11-14T06:19:33.008ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15682024-11-14T06:19:33.009ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15692024-11-14T06:19:33.009ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15702024-11-14T06:19:33.010ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15712024-11-14T06:19:33.013ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15722024-11-14T06:19:33.013ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15732024-11-14T06:19:33.013ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15742024-11-14T06:19:33.026ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15752024-11-14T06:19:33.026ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15762024-11-14T06:19:33.027ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15772024-11-14T06:19:33.027ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15782024-11-14T06:19:33.029ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15792024-11-14T06:19:33.029ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15802024-11-14T06:19:33.030ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15812024-11-14T06:19:33.030ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15822024-11-14T06:19:33.032ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15832024-11-14T06:19:33.032ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15842024-11-14T06:19:33.033ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15852024-11-14T06:19:33.033ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15862024-11-14T06:19:33.034ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15872024-11-14T06:19:33.034ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15882024-11-14T06:19:33.035ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15892024-11-14T06:19:33.039ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15902024-11-14T06:19:33.039ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15912024-11-14T06:19:33.039ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15922024-11-14T06:19:33.040ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15932024-11-14T06:19:33.040ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15942024-11-14T06:19:33.041ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15952024-11-14T06:19:33.041ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15962024-11-14T06:19:33.042ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15972024-11-14T06:19:33.045ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15982024-11-14T06:19:33.045ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15992024-11-14T06:19:33.045ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16002024-11-14T06:19:33.063ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
16012024-11-14T06:19:33.063ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16022024-11-14T06:19:33.063ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16032024-11-14T06:19:33.065ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16042024-11-14T06:19:33.066ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
16052024-11-14T06:19:33.066ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16062024-11-14T06:19:33.066ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16072024-11-14T06:19:33.070ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
16082024-11-14T06:19:33.071ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
16092024-11-14T06:19:33.071ZDEBGnexus (InternalApi): resolved 2 rules for sleds
16102024-11-14T06:19:33.190ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, time_created: 2024-11-14T06:19:28.463914Z, time_modified: 2024-11-14T06:19:28.463914Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
16112024-11-14T06:19:33.190ZDEBGnexus (InternalApi): sending firewall rules to sled agents
16122024-11-14T06:19:33.190ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16132024-11-14T06:19:33.190ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16142024-11-14T06:19:33.193ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
16152024-11-14T06:19:33.193ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
16162024-11-14T06:19:33.194ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16172024-11-14T06:19:33.197ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
16182024-11-14T06:19:33.226ZDEBGnexus (InternalApi): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16192024-11-14T06:19:33.227ZDEBGnexus (InternalApi): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "3119b654-1ee5-4d46-a721-89f1c12818e3", "date": "Thu, 14 Nov 2024 06:19:32 GMT"} })
16202024-11-14T06:19:33.227ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
16212024-11-14T06:19:33.227ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
16222024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = / versions = all
16232024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access versions = all
16242024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path} versions = all
16252024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth versions = all
16262024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm versions = all
16272024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success versions = all
16282024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token versions = all
16292024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify versions = all
16302024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes versions = all
16312024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes versions = all
16322024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
16332024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe} versions = all
16342024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images versions = all
16352024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login versions = all
16362024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local versions = all
16372024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
16382024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
16392024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
16402024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path} versions = all
16412024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path} versions = all
16422024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new versions = all
16432024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path} versions = all
16442024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path} versions = all
16452024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization versions = all
16462024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates versions = all
16472024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates versions = all
16482024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate} versions = all
16492024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate} versions = all
16502024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks versions = all
16512024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks versions = all
16522024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk} versions = all
16532024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk} versions = all
16542024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
16552024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
16562024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
16572024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize versions = all
16582024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
16592024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips versions = all
16602024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips versions = all
16612024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
16622024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
16632024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
16642024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
16652024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
16662024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups versions = all
16672024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id} versions = all
16682024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images versions = all
16692024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images versions = all
16702024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image} versions = all
16712024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image} versions = all
16722024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote versions = all
16732024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote versions = all
16742024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances versions = all
16752024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances versions = all
16762024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance} versions = all
16772024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance} versions = all
16782024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/instances/{instance} versions = all
16792024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks versions = all
16802024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
16812024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
16822024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
16832024-11-14T06:19:33.244ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
16842024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
16852024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot versions = all
16862024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
16872024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
16882024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
16892024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start versions = all
16902024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop versions = all
16912024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
16922024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
16932024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
16942024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
16952024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
16962024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
16972024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways versions = all
16982024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateways versions = all
16992024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
17002024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
17012024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools versions = all
17022024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool} versions = all
17032024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local versions = all
17042024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout versions = all
17052024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me versions = all
17062024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups versions = all
17072024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys versions = all
17082024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys versions = all
17092024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
17102024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
17112024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name} versions = all
17122024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces versions = all
17132024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces versions = all
17142024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
17152024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface} versions = all
17162024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
17172024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping versions = all
17182024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy versions = all
17192024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy versions = all
17202024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects versions = all
17212024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects versions = all
17222024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project} versions = all
17232024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project} versions = all
17242024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project} versions = all
17252024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy versions = all
17262024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy versions = all
17272024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots versions = all
17282024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots versions = all
17292024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
17302024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot} versions = all
17312024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks versions = all
17322024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
17332024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks versions = all
17342024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
17352024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds versions = all
17362024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds versions = all
17372024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
17382024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
17392024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
17402024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
17412024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
17422024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port versions = all
17432024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
17442024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
17452024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
17462024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches versions = all
17472024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
17482024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers versions = all
17492024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users versions = all
17502024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
17512024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
17522024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml versions = all
17532024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
17542024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools versions = all
17552024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools versions = all
17562024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
17572024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
17582024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
17592024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
17602024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
17612024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
17622024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
17632024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
17642024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
17652024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
17662024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
17672024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service versions = all
17682024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
17692024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
17702024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
17712024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
17722024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot versions = all
17732024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot versions = all
17742024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
17752024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
17762024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list versions = all
17772024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list versions = all
17782024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable versions = all
17792024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable versions = all
17802024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status versions = all
17812024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp versions = all
17822024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp versions = all
17832024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp versions = all
17842024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
17852024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
17862024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
17872024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
17882024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-exported versions = all
17892024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
17902024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
17912024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status versions = all
17922024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address versions = all
17932024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address versions = all
17942024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
17952024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
17962024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
17972024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
17982024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
17992024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy versions = all
18002024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy versions = all
18012024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles versions = all
18022024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name} versions = all
18032024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas versions = all
18042024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos versions = all
18052024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos versions = all
18062024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo} versions = all
18072024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo} versions = all
18082024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
18092024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
18102024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
18112024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
18122024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
18132024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/timeseries/query versions = all
18142024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/timeseries/schemas versions = all
18152024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository versions = all
18162024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
18172024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users versions = all
18182024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id} versions = all
18192024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin versions = all
18202024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user} versions = all
18212024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos versions = all
18222024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
18232024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users versions = all
18242024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization versions = all
18252024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules versions = all
18262024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules versions = all
18272024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes versions = all
18282024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes versions = all
18292024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
18302024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
18312024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
18322024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers versions = all
18332024-11-14T06:19:33.245ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers versions = all
18342024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
18352024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router} versions = all
18362024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router} versions = all
18372024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets versions = all
18382024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets versions = all
18392024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
18402024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
18412024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
18422024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
18432024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs versions = all
18442024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs versions = all
18452024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
18462024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc} versions = all
18472024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc} versions = all
18482024-11-14T06:19:33.246ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.6:443
18492024-11-14T06:19:33.246ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
18502024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = / versions = all
18512024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access versions = all
18522024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path} versions = all
18532024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth versions = all
18542024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm versions = all
18552024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success versions = all
18562024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token versions = all
18572024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify versions = all
18582024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes versions = all
18592024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes versions = all
18602024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
18612024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
18622024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images versions = all
18632024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login versions = all
18642024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local versions = all
18652024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
18662024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
18672024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
18682024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path} versions = all
18692024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path} versions = all
18702024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new versions = all
18712024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path} versions = all
18722024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path} versions = all
18732024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization versions = all
18742024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates versions = all
18752024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates versions = all
18762024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
18772024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate} versions = all
18782024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks versions = all
18792024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks versions = all
18802024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk} versions = all
18812024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk} versions = all
18822024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
18832024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
18842024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
18852024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
18862024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
18872024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips versions = all
18882024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips versions = all
18892024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
18902024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
18912024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
18922024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
18932024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
18942024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups versions = all
18952024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id} versions = all
18962024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images versions = all
18972024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images versions = all
18982024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image} versions = all
18992024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image} versions = all
19002024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote versions = all
19012024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote versions = all
19022024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances versions = all
19032024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances versions = all
19042024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance} versions = all
19052024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance} versions = all
19062024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/instances/{instance} versions = all
19072024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
19082024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
19092024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
19102024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
19112024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
19122024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
19132024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
19142024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
19152024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
19162024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
19172024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start versions = all
19182024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
19192024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
19202024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
19212024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
19222024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
19232024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
19242024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
19252024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways versions = all
19262024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateways versions = all
19272024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
19282024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
19292024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools versions = all
19302024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
19312024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
19322024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout versions = all
19332024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me versions = all
19342024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups versions = all
19352024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys versions = all
19362024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys versions = all
19372024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
19382024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
19392024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
19402024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces versions = all
19412024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces versions = all
19422024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
19432024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
19442024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
19452024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping versions = all
19462024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy versions = all
19472024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy versions = all
19482024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects versions = all
19492024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects versions = all
19502024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project} versions = all
19512024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project} versions = all
19522024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project} versions = all
19532024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy versions = all
19542024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
19552024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots versions = all
19562024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots versions = all
19572024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
19582024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
19592024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks versions = all
19602024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
19612024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks versions = all
19622024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
19632024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds versions = all
19642024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds versions = all
19652024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
19662024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
19672024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
19682024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
19692024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
19702024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
19712024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
19722024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
19732024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
19742024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches versions = all
19752024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
19762024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers versions = all
19772024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
19782024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
19792024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
19802024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
19812024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
19822024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools versions = all
19832024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools versions = all
19842024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
19852024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
19862024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
19872024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
19882024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
19892024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
19902024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
19912024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
19922024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
19932024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
19942024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
19952024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service versions = all
19962024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
19972024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
19982024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
19992024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
20002024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot versions = all
20012024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot versions = all
20022024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
20032024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
20042024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list versions = all
20052024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
20062024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
20072024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
20082024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
20092024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
20102024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp versions = all
20112024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp versions = all
20122024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
20132024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
20142024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
20152024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
20162024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
20172024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
20182024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
20192024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
20202024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
20212024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
20222024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
20232024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
20242024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
20252024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
20262024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
20272024-11-14T06:19:33.250ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy versions = all
20282024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy versions = all
20292024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles versions = all
20302024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
20312024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas versions = all
20322024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos versions = all
20332024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos versions = all
20342024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
20352024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo} versions = all
20362024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
20372024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
20382024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
20392024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
20402024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
20412024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/timeseries/query versions = all
20422024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
20432024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository versions = all
20442024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
20452024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users versions = all
20462024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id} versions = all
20472024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin versions = all
20482024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
20492024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos versions = all
20502024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
20512024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users versions = all
20522024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization versions = all
20532024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
20542024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
20552024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes versions = all
20562024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes versions = all
20572024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
20582024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
20592024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
20602024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers versions = all
20612024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers versions = all
20622024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
20632024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
20642024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
20652024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets versions = all
20662024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets versions = all
20672024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
20682024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
20692024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
20702024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
20712024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs versions = all
20722024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs versions = all
20732024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
20742024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
20752024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
20762024-11-14T06:19:33.251ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:12228
20772024-11-14T06:19:33.251ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
20782024-11-14T06:19:33.252ZDEBGnexus (nexus-producer-server): registered DTrace probes
20792024-11-14T06:19:33.254ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:50471 method = GET path = /{producer_id} versions = all
20802024-11-14T06:19:33.255ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:50471
20812024-11-14T06:19:33.255ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:50471
20822024-11-14T06:19:33.255ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:50471
20832024-11-14T06:19:33.255ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
20842024-11-14T06:19:33.255ZDEBGnexus (nexus-producer-server): starting producer registration task
20852024-11-14T06:19:33.256ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:50471 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
20862024-11-14T06:19:33.256ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
20872024-11-14T06:19:33.256ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
20882024-11-14T06:19:33.288ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
20892024-11-14T06:19:33.288ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:44519
20902024-11-14T06:19:33.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44519 req_id = 0c96bc6f-6529-4172-aa61-c05ee7cc7ef2 roles = RoleSet { roles: {} } uri = /metrics/producers
20912024-11-14T06:19:33.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44519 req_id = 0c96bc6f-6529-4172-aa61-c05ee7cc7ef2 resource = Database result = Ok(()) uri = /metrics/producers
20922024-11-14T06:19:33.337ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
20932024-11-14T06:19:33.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48633 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:44519 req_id = 0c96bc6f-6529-4172-aa61-c05ee7cc7ef2 response_code = 201 uri = /metrics/producers
20942024-11-14T06:19:33.337ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "0c96bc6f-6529-4172-aa61-c05ee7cc7ef2", "content-length": "41", "date": "Thu, 14 Nov 2024 06:19:33 GMT"} })
20952024-11-14T06:19:33.338ZDEBGnexus (producer-registration-task): registered with nexus successfully
20962024-11-14T06:19:33.338ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
20972024-11-14T06:19:33.516ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" } server_name = recovery.sys.oxide.test silo_id = 95153e51-68aa-4bd4-8e65-b8164172811d
20982024-11-14T06:19:33.523ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = 172.30.2.6:443 remote_addr = 10.151.2.100:63754
20992024-11-14T06:19:33.529ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21002024-11-14T06:19:33.530ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21012024-11-14T06:19:33.534ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21022024-11-14T06:19:33.534ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21032024-11-14T06:19:33.535ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21042024-11-14T06:19:33.536ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21052024-11-14T06:19:33.537ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21062024-11-14T06:19:33.538ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ByName("recovery") } result = Ok(())
21072024-11-14T06:19:33.538ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21082024-11-14T06:19:33.539ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21092024-11-14T06:19:33.540ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21102024-11-14T06:19:33.540ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21112024-11-14T06:19:33.541ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21122024-11-14T06:19:33.544ZDEBGnexus (ExternalAuthn): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ByName("recovery") } result = Ok(())
21132024-11-14T06:19:33.544ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21142024-11-14T06:19:33.544ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21152024-11-14T06:19:33.551ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21162024-11-14T06:19:33.551ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21172024-11-14T06:19:33.552ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21182024-11-14T06:19:33.553ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21192024-11-14T06:19:33.554ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21202024-11-14T06:19:33.555ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ByName("recovery") }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ByName("recovery") } result = Ok(())
21212024-11-14T06:19:33.555ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21222024-11-14T06:19:33.555ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21232024-11-14T06:19:34.245ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21242024-11-14T06:19:34.246ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21252024-11-14T06:19:34.248ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21262024-11-14T06:19:34.248ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21272024-11-14T06:19:34.249ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21282024-11-14T06:19:34.249ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21292024-11-14T06:19:34.251ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21302024-11-14T06:19:34.251ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21312024-11-14T06:19:34.253ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21322024-11-14T06:19:34.254ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
21332024-11-14T06:19:34.254ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21342024-11-14T06:19:34.254ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21352024-11-14T06:19:34.256ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21362024-11-14T06:19:34.258ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSessionList result = Ok(())
21372024-11-14T06:19:34.258ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21382024-11-14T06:19:34.258ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21392024-11-14T06:19:34.266ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 740657 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:63754 req_id = 19924e32-8739-4970-a715-9ac37685e150 response_code = 204 uri = /v1/login/recovery/local
21402024-11-14T06:19:34.308ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" } server_name = recovery.sys.oxide.test silo_id = 95153e51-68aa-4bd4-8e65-b8164172811d
21412024-11-14T06:19:34.313ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = 172.30.2.6:443 remote_addr = 10.151.2.100:35025
21422024-11-14T06:19:34.315ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21432024-11-14T06:19:34.315ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21442024-11-14T06:19:34.320ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21452024-11-14T06:19:34.320ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21462024-11-14T06:19:34.322ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21472024-11-14T06:19:34.323ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("token = \\"de356d6c0a5ef48397a87a714d15c317ed296def\\"") } result = Ok(())
21482024-11-14T06:19:34.323ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21492024-11-14T06:19:34.323ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21502024-11-14T06:19:34.325ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21512024-11-14T06:19:34.325ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21522024-11-14T06:19:34.327ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21532024-11-14T06:19:34.327ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21542024-11-14T06:19:34.329ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21552024-11-14T06:19:34.329ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21562024-11-14T06:19:34.330ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21572024-11-14T06:19:34.331ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
21582024-11-14T06:19:34.331ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21592024-11-14T06:19:34.331ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21602024-11-14T06:19:34.332ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21612024-11-14T06:19:34.334ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("de356d6c0a5ef48397a87a714d15c317ed296def") } result = Ok(())
21622024-11-14T06:19:34.334ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21632024-11-14T06:19:34.334ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21642024-11-14T06:19:34.345ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21652024-11-14T06:19:34.346ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21662024-11-14T06:19:34.348ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21672024-11-14T06:19:34.348ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21682024-11-14T06:19:34.349ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21692024-11-14T06:19:34.349ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21702024-11-14T06:19:34.350ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21712024-11-14T06:19:34.351ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21722024-11-14T06:19:34.352ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21732024-11-14T06:19:34.353ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
21742024-11-14T06:19:34.353ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21752024-11-14T06:19:34.353ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21762024-11-14T06:19:34.355ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21772024-11-14T06:19:34.355ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21782024-11-14T06:19:34.356ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21792024-11-14T06:19:34.356ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21802024-11-14T06:19:34.358ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21812024-11-14T06:19:34.359ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(())
21822024-11-14T06:19:34.359ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:35025 req_id = d8360136-7539-40e9-aa17-13d7caab4265 roles = RoleSet { roles: {} } uri = /v1/projects
21832024-11-14T06:19:34.359ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:35025 req_id = d8360136-7539-40e9-aa17-13d7caab4265 resource = Database result = Ok(()) uri = /v1/projects
21842024-11-14T06:19:34.371ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:35025 req_id = d8360136-7539-40e9-aa17-13d7caab4265 roles = RoleSet { roles: {} } uri = /v1/projects
21852024-11-14T06:19:34.372ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:35025 req_id = d8360136-7539-40e9-aa17-13d7caab4265 resource = Database result = Ok(()) uri = /v1/projects
21862024-11-14T06:19:34.387ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:35025 req_id = d8360136-7539-40e9-aa17-13d7caab4265 roles = RoleSet { roles: {} } uri = /v1/projects
21872024-11-14T06:19:34.387ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:35025 req_id = d8360136-7539-40e9-aa17-13d7caab4265 resource = Database result = Ok(()) uri = /v1/projects
21882024-11-14T06:19:34.405ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:35025 req_id = d8360136-7539-40e9-aa17-13d7caab4265 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/projects
21892024-11-14T06:19:34.407ZDEBGnexus (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:35025 req_id = d8360136-7539-40e9-aa17-13d7caab4265 resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(()) uri = /v1/projects
21902024-11-14T06:19:34.407ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:35025 req_id = d8360136-7539-40e9-aa17-13d7caab4265 roles = RoleSet { roles: {} } uri = /v1/projects
21912024-11-14T06:19:34.407ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:35025 req_id = d8360136-7539-40e9-aa17-13d7caab4265 resource = Database result = Ok(()) uri = /v1/projects
21922024-11-14T06:19:34.409ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96016 local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:35025 req_id = d8360136-7539-40e9-aa17-13d7caab4265 response_code = 200 uri = /v1/projects
21932024-11-14T06:19:34.456ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21942024-11-14T06:19:34.456ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21952024-11-14T06:19:34.458ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21962024-11-14T06:19:34.458ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21972024-11-14T06:19:34.459ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21982024-11-14T06:19:34.460ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("token = \\"de356d6c0a5ef48397a87a714d15c317ed296def\\"") } result = Ok(())
21992024-11-14T06:19:34.460ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22002024-11-14T06:19:34.461ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22012024-11-14T06:19:34.462ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22022024-11-14T06:19:34.462ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22032024-11-14T06:19:34.463ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22042024-11-14T06:19:34.464ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22052024-11-14T06:19:34.465ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22062024-11-14T06:19:34.465ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22072024-11-14T06:19:34.466ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22082024-11-14T06:19:34.467ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
22092024-11-14T06:19:34.467ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22102024-11-14T06:19:34.468ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22112024-11-14T06:19:34.468ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22122024-11-14T06:19:34.469ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("de356d6c0a5ef48397a87a714d15c317ed296def") } result = Ok(())
22132024-11-14T06:19:34.469ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22142024-11-14T06:19:34.470ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22152024-11-14T06:19:34.488ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22162024-11-14T06:19:34.488ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22172024-11-14T06:19:34.489ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22182024-11-14T06:19:34.489ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22192024-11-14T06:19:34.490ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22202024-11-14T06:19:34.490ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22212024-11-14T06:19:34.492ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22222024-11-14T06:19:34.492ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22232024-11-14T06:19:34.493ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22242024-11-14T06:19:34.494ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
22252024-11-14T06:19:34.494ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22262024-11-14T06:19:34.494ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22272024-11-14T06:19:34.495ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22282024-11-14T06:19:34.495ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22292024-11-14T06:19:34.497ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22302024-11-14T06:19:34.497ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22312024-11-14T06:19:34.498ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22322024-11-14T06:19:34.499ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(())
22332024-11-14T06:19:34.500ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 64f5d068-9b97-4787-ae59-b72a3e8aafaa roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
22342024-11-14T06:19:34.500ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 64f5d068-9b97-4787-ae59-b72a3e8aafaa resource = Database result = Ok(()) uri = /v1/system/ip-pools
22352024-11-14T06:19:34.517ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 64f5d068-9b97-4787-ae59-b72a3e8aafaa roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
22362024-11-14T06:19:34.517ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 64f5d068-9b97-4787-ae59-b72a3e8aafaa resource = Database result = Ok(()) uri = /v1/system/ip-pools
22372024-11-14T06:19:34.519ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 64f5d068-9b97-4787-ae59-b72a3e8aafaa roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/system/ip-pools
22382024-11-14T06:19:34.521ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 64f5d068-9b97-4787-ae59-b72a3e8aafaa resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools
22392024-11-14T06:19:34.521ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 64f5d068-9b97-4787-ae59-b72a3e8aafaa roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
22402024-11-14T06:19:34.521ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 64f5d068-9b97-4787-ae59-b72a3e8aafaa resource = Database result = Ok(()) uri = /v1/system/ip-pools
22412024-11-14T06:19:34.530ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74462 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 64f5d068-9b97-4787-ae59-b72a3e8aafaa response_code = 201 uri = /v1/system/ip-pools
22422024-11-14T06:19:34.535ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22432024-11-14T06:19:34.536ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22442024-11-14T06:19:34.537ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22452024-11-14T06:19:34.537ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22462024-11-14T06:19:34.539ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22472024-11-14T06:19:34.540ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("token = \\"de356d6c0a5ef48397a87a714d15c317ed296def\\"") } result = Ok(())
22482024-11-14T06:19:34.540ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22492024-11-14T06:19:34.540ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22502024-11-14T06:19:34.541ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22512024-11-14T06:19:34.541ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22522024-11-14T06:19:34.542ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22532024-11-14T06:19:34.542ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22542024-11-14T06:19:34.543ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22552024-11-14T06:19:34.544ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22562024-11-14T06:19:34.548ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22572024-11-14T06:19:34.549ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
22582024-11-14T06:19:34.550ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22592024-11-14T06:19:34.550ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22602024-11-14T06:19:34.551ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22612024-11-14T06:19:34.552ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("de356d6c0a5ef48397a87a714d15c317ed296def") } result = Ok(())
22622024-11-14T06:19:34.552ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22632024-11-14T06:19:34.552ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22642024-11-14T06:19:34.555ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22652024-11-14T06:19:34.555ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22662024-11-14T06:19:34.556ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22672024-11-14T06:19:34.556ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22682024-11-14T06:19:34.558ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22692024-11-14T06:19:34.558ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22702024-11-14T06:19:34.559ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22712024-11-14T06:19:34.559ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22722024-11-14T06:19:34.560ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22732024-11-14T06:19:34.561ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
22742024-11-14T06:19:34.561ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22752024-11-14T06:19:34.562ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22762024-11-14T06:19:34.563ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22772024-11-14T06:19:34.563ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22782024-11-14T06:19:34.564ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22792024-11-14T06:19:34.564ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22802024-11-14T06:19:34.565ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22812024-11-14T06:19:34.566ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(())
22822024-11-14T06:19:34.566ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22832024-11-14T06:19:34.566ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22842024-11-14T06:19:34.568ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22852024-11-14T06:19:34.568ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22862024-11-14T06:19:34.585ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22872024-11-14T06:19:34.585ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22882024-11-14T06:19:34.588ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/system/ip-pools/default/silos
22892024-11-14T06:19:34.590ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = IpPool { parent: Fleet, key: a1b13926-924f-4eba-93a9-f1c29c1b56e0, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
22902024-11-14T06:19:34.590ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22912024-11-14T06:19:34.590ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22922024-11-14T06:19:34.598ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22932024-11-14T06:19:34.598ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22942024-11-14T06:19:34.600ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22952024-11-14T06:19:34.600ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22962024-11-14T06:19:34.603ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22972024-11-14T06:19:34.603ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22982024-11-14T06:19:34.605ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22992024-11-14T06:19:34.605ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23002024-11-14T06:19:34.607ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/system/ip-pools/default/silos
23012024-11-14T06:19:34.608ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
23022024-11-14T06:19:34.608ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23032024-11-14T06:19:34.608ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23042024-11-14T06:19:34.610ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23052024-11-14T06:19:34.610ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23062024-11-14T06:19:34.612ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/system/ip-pools/default/silos
23072024-11-14T06:19:34.614ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools/default/silos
23082024-11-14T06:19:34.614ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
23092024-11-14T06:19:34.614ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
23102024-11-14T06:19:34.684ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149765 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 3ccf22e5-0226-4498-a321-c977ebaaaaee response_code = 201 uri = /v1/system/ip-pools/default/silos
23112024-11-14T06:19:34.687ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23122024-11-14T06:19:34.687ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23132024-11-14T06:19:34.706ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23142024-11-14T06:19:34.707ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23152024-11-14T06:19:34.708ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23162024-11-14T06:19:34.709ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("token = \\"de356d6c0a5ef48397a87a714d15c317ed296def\\"") } result = Ok(())
23172024-11-14T06:19:34.709ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23182024-11-14T06:19:34.709ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23192024-11-14T06:19:34.710ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23202024-11-14T06:19:34.710ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23212024-11-14T06:19:34.712ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23222024-11-14T06:19:34.712ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23232024-11-14T06:19:34.713ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23242024-11-14T06:19:34.713ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23252024-11-14T06:19:34.715ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23262024-11-14T06:19:34.716ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
23272024-11-14T06:19:34.716ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23282024-11-14T06:19:34.716ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23292024-11-14T06:19:34.717ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23302024-11-14T06:19:34.718ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("de356d6c0a5ef48397a87a714d15c317ed296def") } result = Ok(())
23312024-11-14T06:19:34.718ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23322024-11-14T06:19:34.718ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23332024-11-14T06:19:34.728ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23342024-11-14T06:19:34.728ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23352024-11-14T06:19:34.729ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23362024-11-14T06:19:34.729ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23372024-11-14T06:19:34.731ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23382024-11-14T06:19:34.731ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23392024-11-14T06:19:34.732ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23402024-11-14T06:19:34.732ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23412024-11-14T06:19:34.733ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23422024-11-14T06:19:34.734ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
23432024-11-14T06:19:34.734ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23442024-11-14T06:19:34.734ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23452024-11-14T06:19:34.735ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23462024-11-14T06:19:34.736ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23472024-11-14T06:19:34.737ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23482024-11-14T06:19:34.737ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23492024-11-14T06:19:34.738ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23502024-11-14T06:19:34.739ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(())
23512024-11-14T06:19:34.739ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23522024-11-14T06:19:34.739ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23532024-11-14T06:19:34.741ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23542024-11-14T06:19:34.742ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23552024-11-14T06:19:34.744ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23562024-11-14T06:19:34.744ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23572024-11-14T06:19:34.745ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
23582024-11-14T06:19:34.747ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc resource = IpPool { parent: Fleet, key: a1b13926-924f-4eba-93a9-f1c29c1b56e0, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23592024-11-14T06:19:34.747ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23602024-11-14T06:19:34.748ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23612024-11-14T06:19:34.749ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23622024-11-14T06:19:34.749ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23632024-11-14T06:19:34.750ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23642024-11-14T06:19:34.750ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23652024-11-14T06:19:34.752ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
23662024-11-14T06:19:34.752ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23672024-11-14T06:19:34.755ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
23682024-11-14T06:19:34.755ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc resource = IpPool { parent: Fleet, key: a1b13926-924f-4eba-93a9-f1c29c1b56e0, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
23692024-11-14T06:19:34.807ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121300 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = b6bdf4da-30f3-4455-a4a9-8fcb244c4dbc response_code = 201 uri = /v1/system/ip-pools/default/ranges/add
23702024-11-14T06:19:34.811ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23712024-11-14T06:19:34.811ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23722024-11-14T06:19:34.812ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23732024-11-14T06:19:34.812ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23742024-11-14T06:19:34.813ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23752024-11-14T06:19:34.815ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("token = \\"de356d6c0a5ef48397a87a714d15c317ed296def\\"") } result = Ok(())
23762024-11-14T06:19:34.815ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23772024-11-14T06:19:34.815ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23782024-11-14T06:19:34.816ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23792024-11-14T06:19:34.816ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23802024-11-14T06:19:34.817ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23812024-11-14T06:19:34.817ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23822024-11-14T06:19:34.819ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23832024-11-14T06:19:34.819ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23842024-11-14T06:19:34.820ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23852024-11-14T06:19:34.821ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
23862024-11-14T06:19:34.821ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23872024-11-14T06:19:34.821ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23882024-11-14T06:19:34.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23892024-11-14T06:19:34.823ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("de356d6c0a5ef48397a87a714d15c317ed296def") } result = Ok(())
23902024-11-14T06:19:34.823ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23912024-11-14T06:19:34.823ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23922024-11-14T06:19:34.829ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23932024-11-14T06:19:34.830ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23942024-11-14T06:19:34.831ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23952024-11-14T06:19:34.831ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23962024-11-14T06:19:34.832ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23972024-11-14T06:19:34.832ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23982024-11-14T06:19:34.833ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23992024-11-14T06:19:34.833ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24002024-11-14T06:19:34.834ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24012024-11-14T06:19:34.836ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
24022024-11-14T06:19:34.836ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24032024-11-14T06:19:34.836ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24042024-11-14T06:19:34.837ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24052024-11-14T06:19:34.837ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24062024-11-14T06:19:34.838ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24072024-11-14T06:19:34.838ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24082024-11-14T06:19:34.840ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24092024-11-14T06:19:34.841ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(())
24102024-11-14T06:19:34.841ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24112024-11-14T06:19:34.841ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24122024-11-14T06:19:34.842ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24132024-11-14T06:19:34.842ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24142024-11-14T06:19:34.844ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24152024-11-14T06:19:34.844ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24162024-11-14T06:19:34.846ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24172024-11-14T06:19:34.847ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24182024-11-14T06:19:34.849ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/system/silos/recovery/quotas
24192024-11-14T06:19:34.850ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
24202024-11-14T06:19:34.850ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24212024-11-14T06:19:34.850ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24222024-11-14T06:19:34.852ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24232024-11-14T06:19:34.853ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24242024-11-14T06:19:34.854ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24252024-11-14T06:19:34.854ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24262024-11-14T06:19:34.856ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/system/silos/recovery/quotas
24272024-11-14T06:19:34.857ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
24282024-11-14T06:19:34.857ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
24292024-11-14T06:19:34.857ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
24302024-11-14T06:19:34.878ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67977 local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:35025 req_id = e2d2802d-5c20-47ce-a141-527bfcfe33a0 response_code = 200 uri = /v1/system/silos/recovery/quotas
24312024-11-14T06:19:34.881ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24322024-11-14T06:19:34.881ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24332024-11-14T06:19:34.882ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24342024-11-14T06:19:34.882ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24352024-11-14T06:19:34.883ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24362024-11-14T06:19:34.884ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("token = \\"de356d6c0a5ef48397a87a714d15c317ed296def\\"") } result = Ok(())
24372024-11-14T06:19:34.884ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24382024-11-14T06:19:34.884ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24392024-11-14T06:19:34.885ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24402024-11-14T06:19:34.885ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24412024-11-14T06:19:34.886ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24422024-11-14T06:19:34.886ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24432024-11-14T06:19:34.888ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24442024-11-14T06:19:34.888ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24452024-11-14T06:19:34.889ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24462024-11-14T06:19:34.890ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
24472024-11-14T06:19:34.890ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24482024-11-14T06:19:34.890ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24492024-11-14T06:19:34.891ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24502024-11-14T06:19:34.892ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("de356d6c0a5ef48397a87a714d15c317ed296def") } result = Ok(())
24512024-11-14T06:19:34.892ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24522024-11-14T06:19:34.892ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24532024-11-14T06:19:34.903ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24542024-11-14T06:19:34.903ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24552024-11-14T06:19:34.904ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24562024-11-14T06:19:34.904ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24572024-11-14T06:19:34.905ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24582024-11-14T06:19:34.906ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24592024-11-14T06:19:34.907ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24602024-11-14T06:19:34.907ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24612024-11-14T06:19:34.908ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24622024-11-14T06:19:34.909ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
24632024-11-14T06:19:34.909ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24642024-11-14T06:19:34.909ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24652024-11-14T06:19:34.910ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24662024-11-14T06:19:34.910ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24672024-11-14T06:19:34.911ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24682024-11-14T06:19:34.911ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24692024-11-14T06:19:34.913ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24702024-11-14T06:19:34.914ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(())
24712024-11-14T06:19:34.914ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 03d997e6-053d-49f0-a4b7-b63f78fd3a99 roles = RoleSet { roles: {} } uri = /v1/projects
24722024-11-14T06:19:34.914ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 03d997e6-053d-49f0-a4b7-b63f78fd3a99 resource = Database result = Ok(()) uri = /v1/projects
24732024-11-14T06:19:34.916ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 03d997e6-053d-49f0-a4b7-b63f78fd3a99 roles = RoleSet { roles: {} } uri = /v1/projects
24742024-11-14T06:19:34.916ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 03d997e6-053d-49f0-a4b7-b63f78fd3a99 resource = Database result = Ok(()) uri = /v1/projects
24752024-11-14T06:19:34.918ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 03d997e6-053d-49f0-a4b7-b63f78fd3a99 roles = RoleSet { roles: {} } uri = /v1/projects
24762024-11-14T06:19:34.918ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 03d997e6-053d-49f0-a4b7-b63f78fd3a99 resource = Database result = Ok(()) uri = /v1/projects
24772024-11-14T06:19:34.920ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 03d997e6-053d-49f0-a4b7-b63f78fd3a99 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/projects
24782024-11-14T06:19:34.921ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 03d997e6-053d-49f0-a4b7-b63f78fd3a99 resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(()) uri = /v1/projects
24792024-11-14T06:19:34.922ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create
24802024-11-14T06:19:34.922ZINFOnexus (SEC): saga create dag = {"end_node":19,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[2,3,null],[16,17,null],[18,0,null],[17,19,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"95153e51-68aa-4bd4-8e65-b8164172811d","lookup_type":{"ById":"95153e51-68aa-4bd4-8e65-b8164172811d"},"parent":null},"project_create":{"description":"","name":"proj-4b3f61ae887"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","silo_user_id":"304f7891-1445-4291-9596-038d243131a2"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"project-create","start_node":18} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
24812024-11-14T06:19:34.922ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create
24822024-11-14T06:19:34.971ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create
24832024-11-14T06:19:34.971ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
24842024-11-14T06:19:34.972ZDEBGnexus (SEC): saga log event new_state = N018 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
24852024-11-14T06:19:34.972ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 18 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
24862024-11-14T06:19:34.980ZDEBGnexus (SEC): saga log event new_state = N018 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
24872024-11-14T06:19:34.980ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
24882024-11-14T06:19:34.990ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
24892024-11-14T06:19:34.990ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
24902024-11-14T06:19:35.002ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = ProjectCreateRecord
24912024-11-14T06:19:35.002ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = ProjectCreateRecord
24922024-11-14T06:19:35.004ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = ProjectCreateRecord
24932024-11-14T06:19:35.004ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = ProjectCreateRecord
24942024-11-14T06:19:35.007ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = ProjectCreateRecord
24952024-11-14T06:19:35.008ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = ProjectCreateRecord
24962024-11-14T06:19:35.010ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = ProjectCreateRecord
24972024-11-14T06:19:35.011ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = ProjectCreateRecord
24982024-11-14T06:19:35.011ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = ProjectCreateRecord
24992024-11-14T06:19:35.012ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = ProjectCreateRecord
25002024-11-14T06:19:35.021ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25012024-11-14T06:19:35.021ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "name": String("proj-4b3f61ae887"), "time_created": String("2024-11-14T06:19:35.002338Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.002338Z")}, "rcgen": Number(1), "silo_id": String("95153e51-68aa-4bd4-8e65-b8164172811d")}]) node_id = 0 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25022024-11-14T06:19:35.026ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25032024-11-14T06:19:35.026ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25042024-11-14T06:19:35.038ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25052024-11-14T06:19:35.038ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "silo_user_id": String("304f7891-1445-4291-9596-038d243131a2")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd0e:23d5:1f14::/48"), "name": String("default")}}) node_id = 1 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25062024-11-14T06:19:35.057ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25072024-11-14T06:19:35.057ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25082024-11-14T06:19:35.062ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25092024-11-14T06:19:35.062ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25102024-11-14T06:19:35.068ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25112024-11-14T06:19:35.068ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25122024-11-14T06:19:35.077ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25132024-11-14T06:19:35.077ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("3c767a11-4d93-4a48-9ca8-576b1fa99839")) node_id = 3 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25142024-11-14T06:19:35.083ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25152024-11-14T06:19:35.083ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25162024-11-14T06:19:35.091ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25172024-11-14T06:19:35.091ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("05c0df51-547f-4ce7-9356-93378cd05c2d")) node_id = 4 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25182024-11-14T06:19:35.100ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25192024-11-14T06:19:35.100ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25202024-11-14T06:19:35.105ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25212024-11-14T06:19:35.105ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("003783e3-be91-4e44-bad8-b2bbe6921019")) node_id = 5 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25222024-11-14T06:19:35.107ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25232024-11-14T06:19:35.108ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25242024-11-14T06:19:35.110ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25252024-11-14T06:19:35.110ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("cf6b2d92-0157-4be4-bdf5-434996cdde1d")) node_id = 6 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25262024-11-14T06:19:35.113ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25272024-11-14T06:19:35.113ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25282024-11-14T06:19:35.116ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25292024-11-14T06:19:35.116ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("085bf894-9d0a-4efa-a674-2f85feee4947")) node_id = 7 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25302024-11-14T06:19:35.121ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25312024-11-14T06:19:35.121ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25322024-11-14T06:19:35.138ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25332024-11-14T06:19:35.138ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("7c260d45-7264-403d-bc1b-e12adb74362c")) node_id = 8 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25342024-11-14T06:19:35.144ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25352024-11-14T06:19:35.144ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25362024-11-14T06:19:35.168ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateVpc
25372024-11-14T06:19:35.169ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateVpc
25382024-11-14T06:19:35.171ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateVpc
25392024-11-14T06:19:35.171ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateVpc
25402024-11-14T06:19:35.173ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateVpc
25412024-11-14T06:19:35.174ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateVpc
25422024-11-14T06:19:35.176ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateVpc
25432024-11-14T06:19:35.176ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateVpc
25442024-11-14T06:19:35.178ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateVpc
25452024-11-14T06:19:35.180ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") } result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateVpc
25462024-11-14T06:19:35.180ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateVpc
25472024-11-14T06:19:35.180ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateVpc
25482024-11-14T06:19:35.211ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25492024-11-14T06:19:35.211ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "name": String("default"), "time_created": String("2024-11-14T06:19:35.168913Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.168913Z")}, "ipv6_prefix": String("fd0e:23d5:1f14::/48"), "project_id": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "subnet_gen": Number(1), "system_router_id": String("05c0df51-547f-4ce7-9356-93378cd05c2d"), "vni": Number(14245811)}]) node_id = 9 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25502024-11-14T06:19:35.218ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25512024-11-14T06:19:35.218ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25522024-11-14T06:19:35.225ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateRouter
25532024-11-14T06:19:35.225ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateRouter
25542024-11-14T06:19:35.229ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateRouter
25552024-11-14T06:19:35.229ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateRouter
25562024-11-14T06:19:35.231ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateRouter
25572024-11-14T06:19:35.231ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateRouter
25582024-11-14T06:19:35.234ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateRouter
25592024-11-14T06:19:35.234ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateRouter
25602024-11-14T06:19:35.237ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateRouter
25612024-11-14T06:19:35.240ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") } result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateRouter
25622024-11-14T06:19:35.240ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateRouter
25632024-11-14T06:19:35.240ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateRouter
25642024-11-14T06:19:35.277ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25652024-11-14T06:19:35.277ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("05c0df51-547f-4ce7-9356-93378cd05c2d"), "lookup_type": Object {"ById": String("05c0df51-547f-4ce7-9356-93378cd05c2d")}, "parent": Object {"key": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}}}) node_id = 10 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25662024-11-14T06:19:35.281ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25672024-11-14T06:19:35.281ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25682024-11-14T06:19:35.286ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV4Route
25692024-11-14T06:19:35.286ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV4Route
25702024-11-14T06:19:35.289ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV4Route
25712024-11-14T06:19:35.289ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV4Route
25722024-11-14T06:19:35.291ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV4Route
25732024-11-14T06:19:35.292ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV4Route
25742024-11-14T06:19:35.294ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV4Route
25752024-11-14T06:19:35.294ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV4Route
25762024-11-14T06:19:35.297ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV4Route
25772024-11-14T06:19:35.300ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") }, key: 05c0df51-547f-4ce7-9356-93378cd05c2d, lookup_type: ById(05c0df51-547f-4ce7-9356-93378cd05c2d) } result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV4Route
25782024-11-14T06:19:35.300ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV4Route
25792024-11-14T06:19:35.300ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV4Route
25802024-11-14T06:19:35.331ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25812024-11-14T06:19:35.331ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25822024-11-14T06:19:35.336ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25832024-11-14T06:19:35.336ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25842024-11-14T06:19:35.339ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV6Route
25852024-11-14T06:19:35.340ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV6Route
25862024-11-14T06:19:35.342ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV6Route
25872024-11-14T06:19:35.342ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV6Route
25882024-11-14T06:19:35.345ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV6Route
25892024-11-14T06:19:35.345ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV6Route
25902024-11-14T06:19:35.347ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV6Route
25912024-11-14T06:19:35.347ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV6Route
25922024-11-14T06:19:35.350ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV6Route
25932024-11-14T06:19:35.353ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") }, key: 05c0df51-547f-4ce7-9356-93378cd05c2d, lookup_type: ById(05c0df51-547f-4ce7-9356-93378cd05c2d) } result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV6Route
25942024-11-14T06:19:35.353ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV6Route
25952024-11-14T06:19:35.353ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateV6Route
25962024-11-14T06:19:35.387ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25972024-11-14T06:19:35.387ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
25982024-11-14T06:19:35.390ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
25992024-11-14T06:19:35.390ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
26002024-11-14T06:19:35.394ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26012024-11-14T06:19:35.394ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26022024-11-14T06:19:35.396ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26032024-11-14T06:19:35.396ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26042024-11-14T06:19:35.399ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26052024-11-14T06:19:35.399ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26062024-11-14T06:19:35.401ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26072024-11-14T06:19:35.401ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26082024-11-14T06:19:35.403ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26092024-11-14T06:19:35.406ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") } result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26102024-11-14T06:19:35.417ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26112024-11-14T06:19:35.417ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26122024-11-14T06:19:35.429ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26132024-11-14T06:19:35.429ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateSubnet
26142024-11-14T06:19:35.433ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
26152024-11-14T06:19:35.433ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("085bf894-9d0a-4efa-a674-2f85feee4947"), "lookup_type": Object {"ById": String("085bf894-9d0a-4efa-a674-2f85feee4947")}, "parent": Object {"key": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("085bf894-9d0a-4efa-a674-2f85feee4947"), "name": String("default"), "time_created": String("2024-11-14T06:19:35.394651Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.394651Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd0e:23d5:1f14::/64"), "rcgen": Number(1), "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")}]) node_id = 13 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
26162024-11-14T06:19:35.436ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
26172024-11-14T06:19:35.436ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
26182024-11-14T06:19:35.440ZDEBGnexus: default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: c1cf8360-172b-48d7-ab1a-85dcabfbbf90, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2024-11-14T06:19:35.440215903Z, time_modified: 2024-11-14T06:19:35.440215903Z, time_deleted: None }, vpc_id: 3c767a11-4d93-4a48-9ca8-576b1fa99839, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 47339082-0fa7-4120-896e-120afce574fe, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2024-11-14T06:19:35.440218563Z, time_modified: 2024-11-14T06:19:35.440218563Z, time_deleted: None }, vpc_id: 3c767a11-4d93-4a48-9ca8-576b1fa99839, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 23b3dedb-1393-4ae3-b07d-384c2735c8af, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2024-11-14T06:19:35.440219563Z, time_modified: 2024-11-14T06:19:35.440219563Z, time_deleted: None }, vpc_id: 3c767a11-4d93-4a48-9ca8-576b1fa99839, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
26192024-11-14T06:19:35.440ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcUpdateFirewall
26202024-11-14T06:19:35.440ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcUpdateFirewall
26212024-11-14T06:19:35.442ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcUpdateFirewall
26222024-11-14T06:19:35.443ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcUpdateFirewall
26232024-11-14T06:19:35.444ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcUpdateFirewall
26242024-11-14T06:19:35.445ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcUpdateFirewall
26252024-11-14T06:19:35.447ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcUpdateFirewall
26262024-11-14T06:19:35.447ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcUpdateFirewall
26272024-11-14T06:19:35.449ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcUpdateFirewall
26282024-11-14T06:19:35.452ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") } result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcUpdateFirewall
26292024-11-14T06:19:35.452ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcUpdateFirewall
26302024-11-14T06:19:35.452ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcUpdateFirewall
26312024-11-14T06:19:35.507ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
26322024-11-14T06:19:35.507ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("c1cf8360-172b-48d7-ab1a-85dcabfbbf90"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-14T06:19:35.440215903Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.440215903Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("47339082-0fa7-4120-896e-120afce574fe"), "name": String("allow-ssh"), "time_created": String("2024-11-14T06:19:35.440218563Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.440218563Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("23b3dedb-1393-4ae3-b07d-384c2735c8af"), "name": String("allow-icmp"), "time_created": String("2024-11-14T06:19:35.440219563Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.440219563Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")}]) node_id = 14 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
26332024-11-14T06:19:35.511ZDEBGnexus (SEC): saga log event new_state = N015 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
26342024-11-14T06:19:35.511ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
26352024-11-14T06:19:35.514ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26362024-11-14T06:19:35.514ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26372024-11-14T06:19:35.517ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26382024-11-14T06:19:35.517ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26392024-11-14T06:19:35.519ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26402024-11-14T06:19:35.519ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26412024-11-14T06:19:35.521ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26422024-11-14T06:19:35.522ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26432024-11-14T06:19:35.524ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26442024-11-14T06:19:35.527ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") } result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26452024-11-14T06:19:35.527ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26462024-11-14T06:19:35.527ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26472024-11-14T06:19:35.534ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26482024-11-14T06:19:35.534ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26492024-11-14T06:19:35.538ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26502024-11-14T06:19:35.538ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26512024-11-14T06:19:35.541ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26522024-11-14T06:19:35.542ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26532024-11-14T06:19:35.547ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26542024-11-14T06:19:35.547ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26552024-11-14T06:19:35.550ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26562024-11-14T06:19:35.550ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26572024-11-14T06:19:35.552ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26582024-11-14T06:19:35.552ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26592024-11-14T06:19:35.554ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26602024-11-14T06:19:35.557ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") }, key: 7c260d45-7264-403d-bc1b-e12adb74362c, lookup_type: ById(7c260d45-7264-403d-bc1b-e12adb74362c) } result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26612024-11-14T06:19:35.557ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26622024-11-14T06:19:35.558ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcCreateGateway
26632024-11-14T06:19:35.576ZDEBGnexus (SEC): saga log event new_state = N015 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
26642024-11-14T06:19:35.576ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("7c260d45-7264-403d-bc1b-e12adb74362c"), "lookup_type": Object {"ById": String("7c260d45-7264-403d-bc1b-e12adb74362c")}, "parent": Object {"key": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}}}) node_id = 15 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
26652024-11-14T06:19:35.581ZDEBGnexus (SEC): saga log event new_state = N016 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
26662024-11-14T06:19:35.581ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
26672024-11-14T06:19:35.584ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26682024-11-14T06:19:35.585ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26692024-11-14T06:19:35.586ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26702024-11-14T06:19:35.586ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26712024-11-14T06:19:35.587ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26722024-11-14T06:19:35.587ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26732024-11-14T06:19:35.589ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26742024-11-14T06:19:35.589ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26752024-11-14T06:19:35.591ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26762024-11-14T06:19:35.591ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26772024-11-14T06:19:35.594ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26782024-11-14T06:19:35.594ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26792024-11-14T06:19:35.595ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26802024-11-14T06:19:35.596ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26812024-11-14T06:19:35.598ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26822024-11-14T06:19:35.601ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ById(b0405cbf-13e7-4232-9a3b-a3f51db78bbf) }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") } result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26832024-11-14T06:19:35.601ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26842024-11-14T06:19:35.601ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26852024-11-14T06:19:35.603ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26862024-11-14T06:19:35.603ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26872024-11-14T06:19:35.605ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26882024-11-14T06:19:35.606ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26892024-11-14T06:19:35.608ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26902024-11-14T06:19:35.608ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26912024-11-14T06:19:35.610ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26922024-11-14T06:19:35.612ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ById(b0405cbf-13e7-4232-9a3b-a3f51db78bbf) }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") } result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26932024-11-14T06:19:35.613ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26942024-11-14T06:19:35.613ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_node = VpcNotifySleds
26952024-11-14T06:19:35.617ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
26962024-11-14T06:19:35.617ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = []
26972024-11-14T06:19:35.618ZDEBGnexus: resolved 0 rules for sleds
26982024-11-14T06:19:35.666ZDEBGnexus: resolved sleds for vpc default vpc_to_sled = []
26992024-11-14T06:19:35.666ZDEBGnexus: sending firewall rules to sled agents
27002024-11-14T06:19:35.666ZINFOnexus: updated firewall rules on 0 sleds file = nexus/networking/src/firewall_rules.rs:496
27012024-11-14T06:19:35.666ZDEBGnexus (SEC): saga log event new_state = N016 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27022024-11-14T06:19:35.666ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
27032024-11-14T06:19:35.670ZDEBGnexus (SEC): saga log event new_state = N017 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27042024-11-14T06:19:35.670ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
27052024-11-14T06:19:35.674ZDEBGnexus (SEC): saga log event new_state = N017 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27062024-11-14T06:19:35.674ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
27072024-11-14T06:19:35.677ZDEBGnexus (SEC): saga log event new_state = N019 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27082024-11-14T06:19:35.677ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 19 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
27092024-11-14T06:19:35.681ZDEBGnexus (SEC): saga log event new_state = N019 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27102024-11-14T06:19:35.681ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
27112024-11-14T06:19:35.684ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27122024-11-14T06:19:35.684ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
27132024-11-14T06:19:35.727ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27142024-11-14T06:19:35.727ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05 saga_name = project-create saga_result = SagaResult { saga_id: 3ee876b4-c0f8-49d4-818a-5ec21497ed05, saga_log: SagaLog { saga_id: 3ee876b4-c0f8-49d4-818a-5ec21497ed05, unwinding: false, events: [N018 started, N018 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N019 started, N019 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "name": String("proj-4b3f61ae887"), "time_created": String("2024-11-14T06:19:35.002338Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.002338Z")}, "rcgen": Number(1), "silo_id": String("95153e51-68aa-4bd4-8e65-b8164172811d")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "silo_user_id": String("304f7891-1445-4291-9596-038d243131a2")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd0e:23d5:1f14::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("3c767a11-4d93-4a48-9ca8-576b1fa99839")), 4: Succeeded(String("05c0df51-547f-4ce7-9356-93378cd05c2d")), 5: Succeeded(String("003783e3-be91-4e44-bad8-b2bbe6921019")), 6: Succeeded(String("cf6b2d92-0157-4be4-bdf5-434996cdde1d")), 7: Succeeded(String("085bf894-9d0a-4efa-a674-2f85feee4947")), 8: Succeeded(String("7c260d45-7264-403d-bc1b-e12adb74362c")), 9: Succeeded(Array [Object {"key": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "name": String("default"), "time_created": String("2024-11-14T06:19:35.168913Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.168913Z")}, "ipv6_prefix": String("fd0e:23d5:1f14::/48"), "project_id": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "subnet_gen": Number(1), "system_router_id": String("05c0df51-547f-4ce7-9356-93378cd05c2d"), "vni": Number(14245811)}]), 10: Succeeded(Object {"key": String("05c0df51-547f-4ce7-9356-93378cd05c2d"), "lookup_type": Object {"ById": String("05c0df51-547f-4ce7-9356-93378cd05c2d")}, "parent": Object {"key": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}}}), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Array [Object {"key": String("085bf894-9d0a-4efa-a674-2f85feee4947"), "lookup_type": Object {"ById": String("085bf894-9d0a-4efa-a674-2f85feee4947")}, "parent": Object {"key": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("085bf894-9d0a-4efa-a674-2f85feee4947"), "name": String("default"), "time_created": String("2024-11-14T06:19:35.394651Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.394651Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd0e:23d5:1f14::/64"), "rcgen": Number(1), "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")}]), 14: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("c1cf8360-172b-48d7-ab1a-85dcabfbbf90"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-14T06:19:35.440215903Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.440215903Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("47339082-0fa7-4120-896e-120afce574fe"), "name": String("allow-ssh"), "time_created": String("2024-11-14T06:19:35.440218563Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.440218563Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("23b3dedb-1393-4ae3-b07d-384c2735c8af"), "name": String("allow-icmp"), "time_created": String("2024-11-14T06:19:35.440219563Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.440219563Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")}]), 15: Succeeded(Object {"key": String("7c260d45-7264-403d-bc1b-e12adb74362c"), "lookup_type": Object {"ById": String("7c260d45-7264-403d-bc1b-e12adb74362c")}, "parent": Object {"key": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}}}), 16: Succeeded(Null), 17: Succeeded(Null), 18: Succeeded(Null), 19: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("7c260d45-7264-403d-bc1b-e12adb74362c"), "default_subnet_id": String("085bf894-9d0a-4efa-a674-2f85feee4947"), "default_v4_route_id": String("003783e3-be91-4e44-bad8-b2bbe6921019"), "default_v6_route_id": String("cf6b2d92-0157-4be4-bdf5-434996cdde1d"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("c1cf8360-172b-48d7-ab1a-85dcabfbbf90"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-14T06:19:35.440215903Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.440215903Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("47339082-0fa7-4120-896e-120afce574fe"), "name": String("allow-ssh"), "time_created": String("2024-11-14T06:19:35.440218563Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.440218563Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("23b3dedb-1393-4ae3-b07d-384c2735c8af"), "name": String("allow-icmp"), "time_created": String("2024-11-14T06:19:35.440219563Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.440219563Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")}], "gateway": Object {"key": String("7c260d45-7264-403d-bc1b-e12adb74362c"), "lookup_type": Object {"ById": String("7c260d45-7264-403d-bc1b-e12adb74362c")}, "parent": Object {"key": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "name": String("proj-4b3f61ae887"), "time_created": String("2024-11-14T06:19:35.002338Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.002338Z")}, "rcgen": Number(1), "silo_id": String("95153e51-68aa-4bd4-8e65-b8164172811d")}], "route4": Null, "route6": Null, "router": Object {"key": String("05c0df51-547f-4ce7-9356-93378cd05c2d"), "lookup_type": Object {"ById": String("05c0df51-547f-4ce7-9356-93378cd05c2d")}, "parent": Object {"key": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("085bf894-9d0a-4efa-a674-2f85feee4947"), "lookup_type": Object {"ById": String("085bf894-9d0a-4efa-a674-2f85feee4947")}, "parent": Object {"key": String("3c767a11-4d93-4a48-9ca8-576b1fa99839"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("085bf894-9d0a-4efa-a674-2f85feee4947"), "name": String("default"), "time_created": String("2024-11-14T06:19:35.394651Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.394651Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd0e:23d5:1f14::/64"), "rcgen": Number(1), "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")}], "system_router_id": String("05c0df51-547f-4ce7-9356-93378cd05c2d"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "lookup_type": Object {"ByName": String("proj-4b3f61ae887")}, "parent": Object {"key": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "lookup_type": Object {"ById": String("95153e51-68aa-4bd4-8e65-b8164172811d")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "silo_user_id": String("304f7891-1445-4291-9596-038d243131a2")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd0e:23d5:1f14::/48"), "name": String("default")}}, "vpc_id": String("3c767a11-4d93-4a48-9ca8-576b1fa99839")} }) }
27152024-11-14T06:19:35.727ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 847510 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 03d997e6-053d-49f0-a4b7-b63f78fd3a99 response_code = 201 uri = /v1/projects
27162024-11-14T06:19:35.732ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27172024-11-14T06:19:35.732ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27182024-11-14T06:19:35.733ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27192024-11-14T06:19:35.733ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27202024-11-14T06:19:35.735ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27212024-11-14T06:19:35.736ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("token = \\"de356d6c0a5ef48397a87a714d15c317ed296def\\"") } result = Ok(())
27222024-11-14T06:19:35.736ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27232024-11-14T06:19:35.736ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27242024-11-14T06:19:35.738ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27252024-11-14T06:19:35.738ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27262024-11-14T06:19:35.739ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27272024-11-14T06:19:35.739ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27282024-11-14T06:19:35.741ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27292024-11-14T06:19:35.741ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27302024-11-14T06:19:35.742ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27312024-11-14T06:19:35.743ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
27322024-11-14T06:19:35.743ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27332024-11-14T06:19:35.743ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27342024-11-14T06:19:35.745ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27352024-11-14T06:19:35.746ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("de356d6c0a5ef48397a87a714d15c317ed296def") } result = Ok(())
27362024-11-14T06:19:35.746ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27372024-11-14T06:19:35.746ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27382024-11-14T06:19:35.751ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27392024-11-14T06:19:35.751ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27402024-11-14T06:19:35.752ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27412024-11-14T06:19:35.753ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27422024-11-14T06:19:35.754ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27432024-11-14T06:19:35.754ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27442024-11-14T06:19:35.755ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27452024-11-14T06:19:35.755ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27462024-11-14T06:19:35.756ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27472024-11-14T06:19:35.758ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
27482024-11-14T06:19:35.758ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27492024-11-14T06:19:35.758ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27502024-11-14T06:19:35.759ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27512024-11-14T06:19:35.759ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27522024-11-14T06:19:35.760ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27532024-11-14T06:19:35.761ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27542024-11-14T06:19:35.762ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27552024-11-14T06:19:35.763ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(())
27562024-11-14T06:19:35.763ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-4b3f61ae887
27572024-11-14T06:19:35.763ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 resource = Database result = Ok(()) uri = /v1/disks?project=proj-4b3f61ae887
27582024-11-14T06:19:35.764ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-4b3f61ae887
27592024-11-14T06:19:35.764ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 resource = Database result = Ok(()) uri = /v1/disks?project=proj-4b3f61ae887
27602024-11-14T06:19:35.766ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-4b3f61ae887
27612024-11-14T06:19:35.767ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 resource = Database result = Ok(()) uri = /v1/disks?project=proj-4b3f61ae887
27622024-11-14T06:19:35.769ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-4b3f61ae887
27632024-11-14T06:19:35.769ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 resource = Database result = Ok(()) uri = /v1/disks?project=proj-4b3f61ae887
27642024-11-14T06:19:35.773ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-4b3f61ae887
27652024-11-14T06:19:35.773ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 resource = Database result = Ok(()) uri = /v1/disks?project=proj-4b3f61ae887
27662024-11-14T06:19:35.776ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-4b3f61ae887
27672024-11-14T06:19:35.776ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 resource = Database result = Ok(()) uri = /v1/disks?project=proj-4b3f61ae887
27682024-11-14T06:19:35.778ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/disks?project=proj-4b3f61ae887
27692024-11-14T06:19:35.780ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 resource = Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") } result = Ok(()) uri = /v1/disks?project=proj-4b3f61ae887
27702024-11-14T06:19:35.780ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create
27712024-11-14T06:19:35.780ZINFOnexus (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.create_disk_record","label":"CreateDiskRecord","name":"created_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"disk_runtime"}},{"Start":{"params":{"create_params":{"description":"","disk_source":{"block_size":512,"type":"blank"},"name":"disk-1d76d5eebb1","size":1073741824},"project_id":"b0405cbf-13e7-4232-9a3b-a3f51db78bbf","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","silo_user_id":"304f7891-1445-4291-9596-038d243131a2"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27722024-11-14T06:19:35.780ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create
27732024-11-14T06:19:35.786ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create
27742024-11-14T06:19:35.786ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27752024-11-14T06:19:35.786ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27762024-11-14T06:19:35.786ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
27772024-11-14T06:19:35.791ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27782024-11-14T06:19:35.791ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
27792024-11-14T06:19:35.795ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27802024-11-14T06:19:35.795ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
27812024-11-14T06:19:35.798ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27822024-11-14T06:19:35.798ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b664cd1d-e61f-4d46-9e33-d36a8b91495e")) node_id = 0 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
27832024-11-14T06:19:35.802ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27842024-11-14T06:19:35.802ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
27852024-11-14T06:19:35.805ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27862024-11-14T06:19:35.805ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")) node_id = 1 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
27872024-11-14T06:19:35.808ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
27882024-11-14T06:19:35.808ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
27892024-11-14T06:19:35.811ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
27902024-11-14T06:19:35.812ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
27912024-11-14T06:19:35.813ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
27922024-11-14T06:19:35.813ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
27932024-11-14T06:19:35.814ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
27942024-11-14T06:19:35.815ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
27952024-11-14T06:19:35.817ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
27962024-11-14T06:19:35.817ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
27972024-11-14T06:19:35.819ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
27982024-11-14T06:19:35.820ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
27992024-11-14T06:19:35.822ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28002024-11-14T06:19:35.822ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28012024-11-14T06:19:35.824ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28022024-11-14T06:19:35.827ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ById(b0405cbf-13e7-4232-9a3b-a3f51db78bbf) } result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28032024-11-14T06:19:35.827ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28042024-11-14T06:19:35.827ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28052024-11-14T06:19:35.829ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28062024-11-14T06:19:35.829ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28072024-11-14T06:19:35.831ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28082024-11-14T06:19:35.831ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28092024-11-14T06:19:35.833ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28102024-11-14T06:19:35.834ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28112024-11-14T06:19:35.836ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28122024-11-14T06:19:35.838ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ById(b0405cbf-13e7-4232-9a3b-a3f51db78bbf) } result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28132024-11-14T06:19:35.838ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28142024-11-14T06:19:35.838ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = CreateDiskRecord
28152024-11-14T06:19:35.886ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28162024-11-14T06:19:35.886ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("b664cd1d-e61f-4d46-9e33-d36a8b91495e"), "name": String("disk-1d76d5eebb1"), "time_created": String("2024-11-14T06:19:35.811880Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.811880Z")}, "pantry_address": Null, "project_id": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-14T06:19:35.811879Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}) node_id = 2 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28172024-11-14T06:19:35.889ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28182024-11-14T06:19:35.889ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28192024-11-14T06:19:35.893ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = RegionsAlloc
28202024-11-14T06:19:35.894ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = RegionsAlloc
28212024-11-14T06:19:35.970ZINFOnexus (datastore): Allocated regions for volume datasets_and_regions = [(Dataset { identity: DatasetIdentity { id: 19078117-c104-4216-992b-fe30db9cf97c, time_created: 2024-11-14T06:19:30.340413Z, time_modified: 2024-11-14T06:19:30.340413Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 93a2b028-0235-4af9-913d-cd3caeb886d5, ip: Some(fd00:1122:3344:101::18), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: a9c66988-198c-4d1b-93ae-fa7c6db1e258, time_created: 2024-11-14T06:19:35.932124Z, time_modified: 2024-11-14T06:19:35.932124Z }, dataset_id: 19078117-c104-4216-992b-fe30db9cf97c, volume_id: d6488f4a-a6e8-4d8b-98fa-651ad213870f, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false }), (Dataset { identity: DatasetIdentity { id: 32011fd6-908c-49e7-9c06-8ad3bd23fac1, time_created: 2024-11-14T06:19:30.340400Z, time_modified: 2024-11-14T06:19:30.340400Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 3687329d-db08-4cdf-99f1-652e017f6592, ip: Some(fd00:1122:3344:101::12), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: a810b16c-5b3f-443a-a45f-14dfc36ba2ac, time_created: 2024-11-14T06:19:35.932124Z, time_modified: 2024-11-14T06:19:35.932124Z }, dataset_id: 32011fd6-908c-49e7-9c06-8ad3bd23fac1, volume_id: d6488f4a-a6e8-4d8b-98fa-651ad213870f, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false }), (Dataset { identity: DatasetIdentity { id: 475def3c-9e09-4a2c-917d-e00544dd910a, time_created: 2024-11-14T06:19:30.340412Z, time_modified: 2024-11-14T06:19:30.340412Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: ad807d5e-9724-4b8a-bcac-1d8b8e2fa374, ip: Some(fd00:1122:3344:101::16), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: aa54bb1a-bb46-4080-8be3-90450651dc83, time_created: 2024-11-14T06:19:35.932124Z, time_modified: 2024-11-14T06:19:35.932124Z }, dataset_id: 475def3c-9e09-4a2c-917d-e00544dd910a, volume_id: d6488f4a-a6e8-4d8b-98fa-651ad213870f, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false })] file = nexus/db-queries/src/db/datastore/region.rs:280 maybe_snapshot_id = None volume_id = d6488f4a-a6e8-4d8b-98fa-651ad213870f
28222024-11-14T06:19:35.970ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28232024-11-14T06:19:35.970ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("19078117-c104-4216-992b-fe30db9cf97c"), "time_created": String("2024-11-14T06:19:30.340413Z"), "time_modified": String("2024-11-14T06:19:30.340413Z")}, "ip": String("fd00:1122:3344:101::18"), "kind": String("Crucible"), "pool_id": String("93a2b028-0235-4af9-913d-cd3caeb886d5"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("19078117-c104-4216-992b-fe30db9cf97c"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("a9c66988-198c-4d1b-93ae-fa7c6db1e258"), "time_created": String("2024-11-14T06:19:35.932124Z"), "time_modified": String("2024-11-14T06:19:35.932124Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}], Array [Object {"compression": Null, "identity": Object {"id": String("32011fd6-908c-49e7-9c06-8ad3bd23fac1"), "time_created": String("2024-11-14T06:19:30.340400Z"), "time_modified": String("2024-11-14T06:19:30.340400Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("3687329d-db08-4cdf-99f1-652e017f6592"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("32011fd6-908c-49e7-9c06-8ad3bd23fac1"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("a810b16c-5b3f-443a-a45f-14dfc36ba2ac"), "time_created": String("2024-11-14T06:19:35.932124Z"), "time_modified": String("2024-11-14T06:19:35.932124Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}], Array [Object {"compression": Null, "identity": Object {"id": String("475def3c-9e09-4a2c-917d-e00544dd910a"), "time_created": String("2024-11-14T06:19:30.340412Z"), "time_modified": String("2024-11-14T06:19:30.340412Z")}, "ip": String("fd00:1122:3344:101::16"), "kind": String("Crucible"), "pool_id": String("ad807d5e-9724-4b8a-bcac-1d8b8e2fa374"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("475def3c-9e09-4a2c-917d-e00544dd910a"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("aa54bb1a-bb46-4080-8be3-90450651dc83"), "time_created": String("2024-11-14T06:19:35.932124Z"), "time_modified": String("2024-11-14T06:19:35.932124Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}]]) node_id = 3 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28242024-11-14T06:19:35.975ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28252024-11-14T06:19:35.975ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28262024-11-14T06:19:35.978ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = SpaceAccount
28272024-11-14T06:19:35.978ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = SpaceAccount
28282024-11-14T06:19:35.996ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28292024-11-14T06:19:35.996ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28302024-11-14T06:19:36.000ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28312024-11-14T06:19:36.000ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28322024-11-14T06:19:36.003ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28332024-11-14T06:19:36.003ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28342024-11-14T06:19:36.006ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28352024-11-14T06:19:36.006ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28362024-11-14T06:19:36.029ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 371.053729ms dataset = 475def3c-9e09-4a2c-917d-e00544dd910a file = nexus/src/app/crucible.rs:230 region = aa54bb1a-bb46-4080-8be3-90450651dc83 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create
28372024-11-14T06:19:36.038ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 226.200466ms dataset = 32011fd6-908c-49e7-9c06-8ad3bd23fac1 file = nexus/src/app/crucible.rs:230 region = a810b16c-5b3f-443a-a45f-14dfc36ba2ac saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create
28382024-11-14T06:19:36.040ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 218.605434ms dataset = 19078117-c104-4216-992b-fe30db9cf97c file = nexus/src/app/crucible.rs:230 region = a9c66988-198c-4d1b-93ae-fa7c6db1e258 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create
28392024-11-14T06:19:36.265ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 348.655087ms dataset = 19078117-c104-4216-992b-fe30db9cf97c file = nexus/src/app/crucible.rs:230 region = a9c66988-198c-4d1b-93ae-fa7c6db1e258 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create
28402024-11-14T06:19:36.270ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 489.452681ms dataset = 32011fd6-908c-49e7-9c06-8ad3bd23fac1 file = nexus/src/app/crucible.rs:230 region = a810b16c-5b3f-443a-a45f-14dfc36ba2ac saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create
28412024-11-14T06:19:36.772ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28422024-11-14T06:19:36.772ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"b664cd1d-e61f-4d46-9e33-d36a8b91495e\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"b664cd1d-e61f-4d46-9e33-d36a8b91495e\\",\\"key\\":\\"A6/35vsk5UCEU/dSFxxJRDj5UTZw9YOYX2eTh2dqdfE=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::16]:19000\\",\\"[fd00:1122:3344:101::18]:19000\\",\\"[fd00:1122:3344:101::12]:19000\\"]}}]}")) node_id = 6 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28432024-11-14T06:19:36.777ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28442024-11-14T06:19:36.777ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28452024-11-14T06:19:36.796ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28462024-11-14T06:19:36.796ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28472024-11-14T06:19:36.800ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28482024-11-14T06:19:36.800ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28492024-11-14T06:19:36.802ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28502024-11-14T06:19:36.803ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28512024-11-14T06:19:36.812ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28522024-11-14T06:19:36.812ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28532024-11-14T06:19:36.813ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28542024-11-14T06:19:36.814ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28552024-11-14T06:19:36.815ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28562024-11-14T06:19:36.815ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28572024-11-14T06:19:36.818ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28582024-11-14T06:19:36.818ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28592024-11-14T06:19:36.820ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28602024-11-14T06:19:36.820ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28612024-11-14T06:19:36.822ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28622024-11-14T06:19:36.822ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28632024-11-14T06:19:36.825ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28642024-11-14T06:19:36.828ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ById(b0405cbf-13e7-4232-9a3b-a3f51db78bbf) }, key: b664cd1d-e61f-4d46-9e33-d36a8b91495e, lookup_type: ById(b664cd1d-e61f-4d46-9e33-d36a8b91495e) } result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28652024-11-14T06:19:36.828ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28662024-11-14T06:19:36.828ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28672024-11-14T06:19:36.830ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28682024-11-14T06:19:36.830ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28692024-11-14T06:19:36.833ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28702024-11-14T06:19:36.833ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28712024-11-14T06:19:36.834ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28722024-11-14T06:19:36.835ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28732024-11-14T06:19:36.837ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28742024-11-14T06:19:36.839ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ById(b0405cbf-13e7-4232-9a3b-a3f51db78bbf) }, key: b664cd1d-e61f-4d46-9e33-d36a8b91495e, lookup_type: ById(b664cd1d-e61f-4d46-9e33-d36a8b91495e) } result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28752024-11-14T06:19:36.839ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28762024-11-14T06:19:36.840ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_node = FinalizeDiskRecord
28772024-11-14T06:19:36.856ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28782024-11-14T06:19:36.856ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28792024-11-14T06:19:36.859ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28802024-11-14T06:19:36.859ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28812024-11-14T06:19:36.863ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28822024-11-14T06:19:36.863ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28832024-11-14T06:19:36.866ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28842024-11-14T06:19:36.866ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
28852024-11-14T06:19:36.878ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
28862024-11-14T06:19:36.878ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a saga_name = disk-create saga_result = SagaResult { saga_id: 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a, saga_log: SagaLog { saga_id: 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("b664cd1d-e61f-4d46-9e33-d36a8b91495e")), 1: Succeeded(String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")), 2: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("b664cd1d-e61f-4d46-9e33-d36a8b91495e"), "name": String("disk-1d76d5eebb1"), "time_created": String("2024-11-14T06:19:35.811880Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.811880Z")}, "pantry_address": Null, "project_id": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-14T06:19:35.811879Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}), 3: Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("19078117-c104-4216-992b-fe30db9cf97c"), "time_created": String("2024-11-14T06:19:30.340413Z"), "time_modified": String("2024-11-14T06:19:30.340413Z")}, "ip": String("fd00:1122:3344:101::18"), "kind": String("Crucible"), "pool_id": String("93a2b028-0235-4af9-913d-cd3caeb886d5"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("19078117-c104-4216-992b-fe30db9cf97c"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("a9c66988-198c-4d1b-93ae-fa7c6db1e258"), "time_created": String("2024-11-14T06:19:35.932124Z"), "time_modified": String("2024-11-14T06:19:35.932124Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}], Array [Object {"compression": Null, "identity": Object {"id": String("32011fd6-908c-49e7-9c06-8ad3bd23fac1"), "time_created": String("2024-11-14T06:19:30.340400Z"), "time_modified": String("2024-11-14T06:19:30.340400Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("3687329d-db08-4cdf-99f1-652e017f6592"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("32011fd6-908c-49e7-9c06-8ad3bd23fac1"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("a810b16c-5b3f-443a-a45f-14dfc36ba2ac"), "time_created": String("2024-11-14T06:19:35.932124Z"), "time_modified": String("2024-11-14T06:19:35.932124Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}], Array [Object {"compression": Null, "identity": Object {"id": String("475def3c-9e09-4a2c-917d-e00544dd910a"), "time_created": String("2024-11-14T06:19:30.340412Z"), "time_modified": String("2024-11-14T06:19:30.340412Z")}, "ip": String("fd00:1122:3344:101::16"), "kind": String("Crucible"), "pool_id": String("ad807d5e-9724-4b8a-bcac-1d8b8e2fa374"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("475def3c-9e09-4a2c-917d-e00544dd910a"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("aa54bb1a-bb46-4080-8be3-90450651dc83"), "time_created": String("2024-11-14T06:19:35.932124Z"), "time_modified": String("2024-11-14T06:19:35.932124Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}]]), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"b664cd1d-e61f-4d46-9e33-d36a8b91495e\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"b664cd1d-e61f-4d46-9e33-d36a8b91495e\\",\\"key\\":\\"A6/35vsk5UCEU/dSFxxJRDj5UTZw9YOYX2eTh2dqdfE=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::16]:19000\\",\\"[fd00:1122:3344:101::18]:19000\\",\\"[fd00:1122:3344:101::12]:19000\\"]}}]}")), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"created_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("b664cd1d-e61f-4d46-9e33-d36a8b91495e"), "name": String("disk-1d76d5eebb1"), "time_created": String("2024-11-14T06:19:35.811880Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.811880Z")}, "pantry_address": Null, "project_id": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-14T06:19:35.811879Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}, "created_volume": Null, "datasets_and_regions": Array [Array [Object {"compression": Null, "identity": Object {"id": String("19078117-c104-4216-992b-fe30db9cf97c"), "time_created": String("2024-11-14T06:19:30.340413Z"), "time_modified": String("2024-11-14T06:19:30.340413Z")}, "ip": String("fd00:1122:3344:101::18"), "kind": String("Crucible"), "pool_id": String("93a2b028-0235-4af9-913d-cd3caeb886d5"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("19078117-c104-4216-992b-fe30db9cf97c"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("a9c66988-198c-4d1b-93ae-fa7c6db1e258"), "time_created": String("2024-11-14T06:19:35.932124Z"), "time_modified": String("2024-11-14T06:19:35.932124Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}], Array [Object {"compression": Null, "identity": Object {"id": String("32011fd6-908c-49e7-9c06-8ad3bd23fac1"), "time_created": String("2024-11-14T06:19:30.340400Z"), "time_modified": String("2024-11-14T06:19:30.340400Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("3687329d-db08-4cdf-99f1-652e017f6592"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("32011fd6-908c-49e7-9c06-8ad3bd23fac1"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("a810b16c-5b3f-443a-a45f-14dfc36ba2ac"), "time_created": String("2024-11-14T06:19:35.932124Z"), "time_modified": String("2024-11-14T06:19:35.932124Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}], Array [Object {"compression": Null, "identity": Object {"id": String("475def3c-9e09-4a2c-917d-e00544dd910a"), "time_created": String("2024-11-14T06:19:30.340412Z"), "time_modified": String("2024-11-14T06:19:30.340412Z")}, "ip": String("fd00:1122:3344:101::16"), "kind": String("Crucible"), "pool_id": String("ad807d5e-9724-4b8a-bcac-1d8b8e2fa374"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("475def3c-9e09-4a2c-917d-e00544dd910a"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("aa54bb1a-bb46-4080-8be3-90450651dc83"), "time_created": String("2024-11-14T06:19:35.932124Z"), "time_modified": String("2024-11-14T06:19:35.932124Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}]], "disk_id": String("b664cd1d-e61f-4d46-9e33-d36a8b91495e"), "disk_runtime": Null, "no_result": Null, "regions_ensure": String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"b664cd1d-e61f-4d46-9e33-d36a8b91495e\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"b664cd1d-e61f-4d46-9e33-d36a8b91495e\\",\\"key\\":\\"A6/35vsk5UCEU/dSFxxJRDj5UTZw9YOYX2eTh2dqdfE=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::16]:19000\\",\\"[fd00:1122:3344:101::18]:19000\\",\\"[fd00:1122:3344:101::12]:19000\\"]}}]}"), "regions_ensure_undo": Null, "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")} }) }
28872024-11-14T06:19:36.878ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1147676 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = d322db27-1eb5-40b2-84e9-6aa1109ee185 response_code = 201 uri = /v1/disks?project=proj-4b3f61ae887
28882024-11-14T06:19:36.880ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28892024-11-14T06:19:36.881ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28902024-11-14T06:19:36.882ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28912024-11-14T06:19:36.882ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28922024-11-14T06:19:36.883ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28932024-11-14T06:19:36.885ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("token = \\"de356d6c0a5ef48397a87a714d15c317ed296def\\"") } result = Ok(())
28942024-11-14T06:19:36.885ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28952024-11-14T06:19:36.885ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28962024-11-14T06:19:36.886ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28972024-11-14T06:19:36.886ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28982024-11-14T06:19:36.887ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28992024-11-14T06:19:36.887ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29002024-11-14T06:19:36.889ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29012024-11-14T06:19:36.889ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29022024-11-14T06:19:36.890ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29032024-11-14T06:19:36.891ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
29042024-11-14T06:19:36.891ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29052024-11-14T06:19:36.891ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29062024-11-14T06:19:36.892ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29072024-11-14T06:19:36.893ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("de356d6c0a5ef48397a87a714d15c317ed296def") } result = Ok(())
29082024-11-14T06:19:36.893ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29092024-11-14T06:19:36.893ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29102024-11-14T06:19:36.896ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29112024-11-14T06:19:36.897ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29122024-11-14T06:19:36.897ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29132024-11-14T06:19:36.898ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29142024-11-14T06:19:36.901ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29152024-11-14T06:19:36.901ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29162024-11-14T06:19:36.902ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29172024-11-14T06:19:36.902ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29182024-11-14T06:19:36.904ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29192024-11-14T06:19:36.905ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
29202024-11-14T06:19:36.905ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29212024-11-14T06:19:36.905ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29222024-11-14T06:19:36.906ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29232024-11-14T06:19:36.906ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29242024-11-14T06:19:36.907ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29252024-11-14T06:19:36.907ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29262024-11-14T06:19:36.909ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29272024-11-14T06:19:36.910ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(())
29282024-11-14T06:19:36.910ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29292024-11-14T06:19:36.910ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29302024-11-14T06:19:36.911ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29312024-11-14T06:19:36.911ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29322024-11-14T06:19:36.913ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29332024-11-14T06:19:36.913ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29342024-11-14T06:19:36.916ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29352024-11-14T06:19:36.916ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29362024-11-14T06:19:36.918ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29372024-11-14T06:19:36.918ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29382024-11-14T06:19:36.920ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29392024-11-14T06:19:36.920ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29402024-11-14T06:19:36.922ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29412024-11-14T06:19:36.922ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29422024-11-14T06:19:36.924ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29432024-11-14T06:19:36.927ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: b664cd1d-e61f-4d46-9e33-d36a8b91495e, lookup_type: ByName("disk-1d76d5eebb1") } result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29442024-11-14T06:19:36.927ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29452024-11-14T06:19:36.927ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29462024-11-14T06:19:36.929ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29472024-11-14T06:19:36.929ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29482024-11-14T06:19:36.930ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29492024-11-14T06:19:36.930ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29502024-11-14T06:19:36.932ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29512024-11-14T06:19:36.932ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29522024-11-14T06:19:36.934ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29532024-11-14T06:19:36.934ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29542024-11-14T06:19:36.936ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29552024-11-14T06:19:36.936ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29562024-11-14T06:19:36.939ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29572024-11-14T06:19:36.939ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Database result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29582024-11-14T06:19:36.940ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29592024-11-14T06:19:36.943ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ById(b0405cbf-13e7-4232-9a3b-a3f51db78bbf) }, key: b664cd1d-e61f-4d46-9e33-d36a8b91495e, lookup_type: ById(b664cd1d-e61f-4d46-9e33-d36a8b91495e) } result = Ok(()) uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
29602024-11-14T06:19:36.943ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete
29612024-11-14T06:19:36.943ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","silo_user_id":"304f7891-1445-4291-9596-038d243131a2"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"d6488f4a-a6e8-4d8b-98fa-651ad213870f"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"b664cd1d-e61f-4d46-9e33-d36a8b91495e","project_id":"b0405cbf-13e7-4232-9a3b-a3f51db78bbf","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","silo_user_id":"304f7891-1445-4291-9596-038d243131a2"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"d6488f4a-a6e8-4d8b-98fa-651ad213870f"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29622024-11-14T06:19:36.943ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete
29632024-11-14T06:19:36.946ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete
29642024-11-14T06:19:36.946ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29652024-11-14T06:19:36.946ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29662024-11-14T06:19:36.946ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29672024-11-14T06:19:36.951ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29682024-11-14T06:19:36.951ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29692024-11-14T06:19:36.954ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29702024-11-14T06:19:36.954ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29712024-11-14T06:19:36.967ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29722024-11-14T06:19:36.967ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("b664cd1d-e61f-4d46-9e33-d36a8b91495e"), "name": String("disk-1d76d5eebb1"), "time_created": String("2024-11-14T06:19:35.811880Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.811880Z")}, "pantry_address": Null, "project_id": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-14T06:19:36.828099Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}) node_id = 0 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29732024-11-14T06:19:36.971ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29742024-11-14T06:19:36.971ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29752024-11-14T06:19:36.974ZDEBGnexus (SagaExecutor): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true roles = RoleSet { roles: {} } saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete saga_node = SpaceAccount
29762024-11-14T06:19:36.975ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true resource = Database result = Ok(()) saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete saga_node = SpaceAccount
29772024-11-14T06:19:36.989ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29782024-11-14T06:19:36.989ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29792024-11-14T06:19:36.992ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29802024-11-14T06:19:36.992ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29812024-11-14T06:19:36.994ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29822024-11-14T06:19:36.994ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "silo_user_id": String("304f7891-1445-4291-9596-038d243131a2")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}) node_id = 2 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29832024-11-14T06:19:36.998ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29842024-11-14T06:19:36.998ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29852024-11-14T06:19:37.002ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29862024-11-14T06:19:37.002ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29872024-11-14T06:19:37.005ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29882024-11-14T06:19:37.005ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29892024-11-14T06:19:37.025ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29902024-11-14T06:19:37.025ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("aa54bb1a-bb46-4080-8be3-90450651dc83"), String("a9c66988-198c-4d1b-93ae-fa7c6db1e258"), String("a810b16c-5b3f-443a-a45f-14dfc36ba2ac")]}}) node_id = 4 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29912024-11-14T06:19:37.029ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29922024-11-14T06:19:37.029ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29932024-11-14T06:19:37.032ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29942024-11-14T06:19:37.032ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29952024-11-14T06:19:37.037ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
29962024-11-14T06:19:37.037ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
29972024-11-14T06:19:37.069ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 120.722873ms file = nexus/src/app/crucible.rs:827 region_id = a9c66988-198c-4d1b-93ae-fa7c6db1e258 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete
29982024-11-14T06:19:37.070ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 144.639509ms file = nexus/src/app/crucible.rs:827 region_id = aa54bb1a-bb46-4080-8be3-90450651dc83 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete
29992024-11-14T06:19:37.070ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 56.40396ms file = nexus/src/app/crucible.rs:827 region_id = a810b16c-5b3f-443a-a45f-14dfc36ba2ac saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete
30002024-11-14T06:19:37.131ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 84.013831ms file = nexus/src/app/crucible.rs:827 region_id = a810b16c-5b3f-443a-a45f-14dfc36ba2ac saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete
30012024-11-14T06:19:37.194ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = a9c66988-198c-4d1b-93ae-fa7c6db1e258 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete
30022024-11-14T06:19:37.219ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = aa54bb1a-bb46-4080-8be3-90450651dc83 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete
30032024-11-14T06:19:37.221ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = a810b16c-5b3f-443a-a45f-14dfc36ba2ac saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete
30042024-11-14T06:19:37.239ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30052024-11-14T06:19:37.239ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30062024-11-14T06:19:37.243ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30072024-11-14T06:19:37.243ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30082024-11-14T06:19:37.248ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30092024-11-14T06:19:37.248ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30102024-11-14T06:19:37.252ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30112024-11-14T06:19:37.252ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30122024-11-14T06:19:37.255ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30132024-11-14T06:19:37.255ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30142024-11-14T06:19:37.258ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30152024-11-14T06:19:37.258ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30162024-11-14T06:19:37.274ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30172024-11-14T06:19:37.274ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 9 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30182024-11-14T06:19:37.276ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30192024-11-14T06:19:37.276ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30202024-11-14T06:19:37.279ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30212024-11-14T06:19:37.279ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30222024-11-14T06:19:37.283ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30232024-11-14T06:19:37.283ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30242024-11-14T06:19:37.289ZINFOnexus (SagaExecutor): allocated regions for d6488f4a-a6e8-4d8b-98fa-651ad213870f is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:531 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete
30252024-11-14T06:19:37.298ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30262024-11-14T06:19:37.298ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30272024-11-14T06:19:37.302ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30282024-11-14T06:19:37.302ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30292024-11-14T06:19:37.305ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30302024-11-14T06:19:37.305ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30312024-11-14T06:19:37.311ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30322024-11-14T06:19:37.311ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30332024-11-14T06:19:37.315ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30342024-11-14T06:19:37.315ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30352024-11-14T06:19:37.318ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30362024-11-14T06:19:37.318ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
30372024-11-14T06:19:37.324ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete sec_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
30382024-11-14T06:19:37.324ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37 saga_name = disk-delete saga_result = SagaResult { saga_id: 941474d3-6904-4a90-8570-1d1ce9f47f37, saga_log: SagaLog { saga_id: 941474d3-6904-4a90-8570-1d1ce9f47f37, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("b664cd1d-e61f-4d46-9e33-d36a8b91495e"), "name": String("disk-1d76d5eebb1"), "time_created": String("2024-11-14T06:19:35.811880Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.811880Z")}, "pantry_address": Null, "project_id": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-14T06:19:36.828099Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "silo_user_id": String("304f7891-1445-4291-9596-038d243131a2")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("aa54bb1a-bb46-4080-8be3-90450651dc83"), String("a9c66988-198c-4d1b-93ae-fa7c6db1e258"), String("a810b16c-5b3f-443a-a45f-14dfc36ba2ac")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Array []), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("aa54bb1a-bb46-4080-8be3-90450651dc83"), String("a9c66988-198c-4d1b-93ae-fa7c6db1e258"), String("a810b16c-5b3f-443a-a45f-14dfc36ba2ac")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("b664cd1d-e61f-4d46-9e33-d36a8b91495e"), "name": String("disk-1d76d5eebb1"), "time_created": String("2024-11-14T06:19:35.811880Z"), "time_deleted": Null, "time_modified": String("2024-11-14T06:19:35.811880Z")}, "pantry_address": Null, "project_id": String("b0405cbf-13e7-4232-9a3b-a3f51db78bbf"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-14T06:19:36.828099Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}, "freed_crucible_regions": Array [], "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("95153e51-68aa-4bd4-8e65-b8164172811d"), "silo_user_id": String("304f7891-1445-4291-9596-038d243131a2")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("d6488f4a-a6e8-4d8b-98fa-651ad213870f")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
30392024-11-14T06:19:37.324ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 444029 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = c3bfe0cb-e420-47ca-895b-e24fe515575c response_code = 204 uri = /v1/disks/disk-1d76d5eebb1?project=proj-4b3f61ae887
30402024-11-14T06:19:37.326ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30412024-11-14T06:19:37.326ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30422024-11-14T06:19:37.327ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30432024-11-14T06:19:37.329ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = DeviceAuthRequestList result = Ok(())
30442024-11-14T06:19:37.329ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30452024-11-14T06:19:37.329ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30462024-11-14T06:19:37.341ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15638 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = 5a87f7a4-0585-4037-92e5-0b2bb67187e4 response_code = 200 uri = /device/auth
30472024-11-14T06:19:37.343ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30482024-11-14T06:19:37.343ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30492024-11-14T06:19:37.344ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30502024-11-14T06:19:37.344ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30512024-11-14T06:19:37.345ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30522024-11-14T06:19:37.347ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("token = \\"de356d6c0a5ef48397a87a714d15c317ed296def\\"") } result = Ok(())
30532024-11-14T06:19:37.347ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30542024-11-14T06:19:37.347ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30552024-11-14T06:19:37.348ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30562024-11-14T06:19:37.348ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30572024-11-14T06:19:37.350ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30582024-11-14T06:19:37.350ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30592024-11-14T06:19:37.351ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30602024-11-14T06:19:37.351ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30612024-11-14T06:19:37.353ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30622024-11-14T06:19:37.354ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
30632024-11-14T06:19:37.354ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30642024-11-14T06:19:37.354ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30652024-11-14T06:19:37.355ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30662024-11-14T06:19:37.356ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("de356d6c0a5ef48397a87a714d15c317ed296def") } result = Ok(())
30672024-11-14T06:19:37.356ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30682024-11-14T06:19:37.356ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30692024-11-14T06:19:37.361ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30702024-11-14T06:19:37.361ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30712024-11-14T06:19:37.362ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30722024-11-14T06:19:37.362ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30732024-11-14T06:19:37.364ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30742024-11-14T06:19:37.364ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30752024-11-14T06:19:37.365ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30762024-11-14T06:19:37.366ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30772024-11-14T06:19:37.367ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30782024-11-14T06:19:37.368ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
30792024-11-14T06:19:37.368ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30802024-11-14T06:19:37.368ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30812024-11-14T06:19:37.369ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30822024-11-14T06:19:37.369ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30832024-11-14T06:19:37.370ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30842024-11-14T06:19:37.371ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30852024-11-14T06:19:37.372ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30862024-11-14T06:19:37.373ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(())
30872024-11-14T06:19:37.373ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
30882024-11-14T06:19:37.373ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
30892024-11-14T06:19:37.381ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
30902024-11-14T06:19:37.381ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
30912024-11-14T06:19:37.383ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
30922024-11-14T06:19:37.383ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
30932024-11-14T06:19:37.386ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /device/confirm
30942024-11-14T06:19:37.387ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = DeviceAuthRequest { parent: Fleet, key: "CDSH-RFLV", lookup_type: ByCompositeId("user_code = \\"CDSH-RFLV\\"") } result = Ok(()) uri = /device/confirm
30952024-11-14T06:19:37.387ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
30962024-11-14T06:19:37.387ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
30972024-11-14T06:19:37.388ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
30982024-11-14T06:19:37.388ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
30992024-11-14T06:19:37.390ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
31002024-11-14T06:19:37.390ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
31012024-11-14T06:19:37.397ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
31022024-11-14T06:19:37.397ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
31032024-11-14T06:19:37.399ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
31042024-11-14T06:19:37.399ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
31052024-11-14T06:19:37.401ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /device/confirm
31062024-11-14T06:19:37.402ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(()) uri = /device/confirm
31072024-11-14T06:19:37.402ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
31082024-11-14T06:19:37.403ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
31092024-11-14T06:19:37.406ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
31102024-11-14T06:19:37.406ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
31112024-11-14T06:19:37.408ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /device/confirm
31122024-11-14T06:19:37.409ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = DeviceAuthRequest { parent: Fleet, key: "CDSH-RFLV", lookup_type: ByCompositeId("user_code = \\"CDSH-RFLV\\"") } result = Ok(()) uri = /device/confirm
31132024-11-14T06:19:37.409ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
31142024-11-14T06:19:37.409ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
31152024-11-14T06:19:37.412ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
31162024-11-14T06:19:37.412ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
31172024-11-14T06:19:37.413ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
31182024-11-14T06:19:37.414ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
31192024-11-14T06:19:37.416ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /device/confirm
31202024-11-14T06:19:37.417ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(()) uri = /device/confirm
31212024-11-14T06:19:37.417ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 roles = RoleSet { roles: {} } uri = /device/confirm
31222024-11-14T06:19:37.417ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 resource = Database result = Ok(()) uri = /device/confirm
31232024-11-14T06:19:37.441ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98692 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = abdf57c4-187c-4873-893f-c9082f500f40 response_code = 204 uri = /device/confirm
31242024-11-14T06:19:37.443ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31252024-11-14T06:19:37.443ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31262024-11-14T06:19:37.452ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9400 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35025 req_id = edbaf23c-e65e-4742-9be7-bcbdc7d4088c response_code = 200 uri = /device/token
31272024-11-14T06:19:37.455ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31282024-11-14T06:19:37.455ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31292024-11-14T06:19:37.456ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31302024-11-14T06:19:37.456ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31312024-11-14T06:19:37.457ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31322024-11-14T06:19:37.458ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("token = \\"de356d6c0a5ef48397a87a714d15c317ed296def\\"") } result = Ok(())
31332024-11-14T06:19:37.458ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31342024-11-14T06:19:37.459ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31352024-11-14T06:19:37.460ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31362024-11-14T06:19:37.460ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31372024-11-14T06:19:37.462ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31382024-11-14T06:19:37.462ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31392024-11-14T06:19:37.463ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31402024-11-14T06:19:37.463ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31412024-11-14T06:19:37.465ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31422024-11-14T06:19:37.466ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
31432024-11-14T06:19:37.466ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31442024-11-14T06:19:37.466ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31452024-11-14T06:19:37.467ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31462024-11-14T06:19:37.468ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("de356d6c0a5ef48397a87a714d15c317ed296def") } result = Ok(())
31472024-11-14T06:19:37.468ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31482024-11-14T06:19:37.469ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31492024-11-14T06:19:37.472ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31502024-11-14T06:19:37.472ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31512024-11-14T06:19:37.473ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31522024-11-14T06:19:37.474ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31532024-11-14T06:19:37.475ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31542024-11-14T06:19:37.475ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31552024-11-14T06:19:37.476ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31562024-11-14T06:19:37.477ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31572024-11-14T06:19:37.477ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31582024-11-14T06:19:37.478ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
31592024-11-14T06:19:37.478ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31602024-11-14T06:19:37.479ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31612024-11-14T06:19:37.480ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31622024-11-14T06:19:37.480ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31632024-11-14T06:19:37.481ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31642024-11-14T06:19:37.481ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31652024-11-14T06:19:37.483ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31662024-11-14T06:19:37.484ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(())
31672024-11-14T06:19:37.484ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31682024-11-14T06:19:37.484ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31692024-11-14T06:19:37.486ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31702024-11-14T06:19:37.486ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31712024-11-14T06:19:37.487ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31722024-11-14T06:19:37.488ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31732024-11-14T06:19:37.489ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31742024-11-14T06:19:37.489ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31752024-11-14T06:19:37.491ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31762024-11-14T06:19:37.491ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31772024-11-14T06:19:37.501ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31782024-11-14T06:19:37.501ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31792024-11-14T06:19:37.503ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31802024-11-14T06:19:37.503ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31812024-11-14T06:19:37.505ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31822024-11-14T06:19:37.505ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31832024-11-14T06:19:37.508ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31842024-11-14T06:19:37.511ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") }, key: 085bf894-9d0a-4efa-a674-2f85feee4947, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31852024-11-14T06:19:37.511ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31862024-11-14T06:19:37.511ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31872024-11-14T06:19:37.513ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31882024-11-14T06:19:37.513ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31892024-11-14T06:19:37.516ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31902024-11-14T06:19:37.516ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31912024-11-14T06:19:37.518ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31922024-11-14T06:19:37.519ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31932024-11-14T06:19:37.520ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31942024-11-14T06:19:37.523ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") }, key: 085bf894-9d0a-4efa-a674-2f85feee4947, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31952024-11-14T06:19:37.523ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31962024-11-14T06:19:37.523ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31972024-11-14T06:19:37.526ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31982024-11-14T06:19:37.526ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
31992024-11-14T06:19:37.529ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
32002024-11-14T06:19:37.530ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
32012024-11-14T06:19:37.567ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
32022024-11-14T06:19:37.567ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
32032024-11-14T06:19:37.575ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120352 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 2dc287e5-d247-4854-b271-69723bbe6080 response_code = 204 uri = /v1/vpc-subnets/default?project=proj-4b3f61ae887&vpc=default
32042024-11-14T06:19:37.575ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Signaled
32052024-11-14T06:19:37.575ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32062024-11-14T06:19:37.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32072024-11-14T06:19:37.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32082024-11-14T06:19:37.576ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32092024-11-14T06:19:37.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32102024-11-14T06:19:37.577ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32112024-11-14T06:19:37.578ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32122024-11-14T06:19:37.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32132024-11-14T06:19:37.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32142024-11-14T06:19:37.578ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32152024-11-14T06:19:37.578ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32162024-11-14T06:19:37.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32172024-11-14T06:19:37.580ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32182024-11-14T06:19:37.581ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("token = \\"de356d6c0a5ef48397a87a714d15c317ed296def\\"") } result = Ok(())
32192024-11-14T06:19:37.581ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32202024-11-14T06:19:37.582ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32212024-11-14T06:19:37.582ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32222024-11-14T06:19:37.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32232024-11-14T06:19:37.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32242024-11-14T06:19:37.583ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32252024-11-14T06:19:37.583ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32262024-11-14T06:19:37.585ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32272024-11-14T06:19:37.585ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32282024-11-14T06:19:37.586ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32292024-11-14T06:19:37.587ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32302024-11-14T06:19:37.588ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32312024-11-14T06:19:37.589ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
32322024-11-14T06:19:37.589ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32332024-11-14T06:19:37.589ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32342024-11-14T06:19:37.591ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32352024-11-14T06:19:37.592ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("de356d6c0a5ef48397a87a714d15c317ed296def") } result = Ok(())
32362024-11-14T06:19:37.592ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32372024-11-14T06:19:37.592ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32382024-11-14T06:19:37.616ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32392024-11-14T06:19:37.616ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32402024-11-14T06:19:37.616ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "277e663b-f56a-4e04-8996-877cd4eca657", "content-length": "372", "date": "Thu, 14 Nov 2024 06:19:37 GMT"} })
32412024-11-14T06:19:37.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32422024-11-14T06:19:37.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32432024-11-14T06:19:37.619ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32442024-11-14T06:19:37.619ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32452024-11-14T06:19:37.620ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32462024-11-14T06:19:37.621ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32472024-11-14T06:19:37.622ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32482024-11-14T06:19:37.622ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32492024-11-14T06:19:37.624ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32502024-11-14T06:19:37.624ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32512024-11-14T06:19:37.625ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32522024-11-14T06:19:37.626ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
32532024-11-14T06:19:37.626ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32542024-11-14T06:19:37.626ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32552024-11-14T06:19:37.628ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32562024-11-14T06:19:37.628ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32572024-11-14T06:19:37.629ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32582024-11-14T06:19:37.630ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32592024-11-14T06:19:37.631ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32602024-11-14T06:19:37.632ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(())
32612024-11-14T06:19:37.632ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32622024-11-14T06:19:37.632ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32632024-11-14T06:19:37.634ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32642024-11-14T06:19:37.634ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32652024-11-14T06:19:37.635ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32662024-11-14T06:19:37.635ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32672024-11-14T06:19:37.637ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32682024-11-14T06:19:37.637ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32692024-11-14T06:19:37.640ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32702024-11-14T06:19:37.640ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32712024-11-14T06:19:37.642ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32722024-11-14T06:19:37.642ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32732024-11-14T06:19:37.645ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32742024-11-14T06:19:37.645ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32752024-11-14T06:19:37.647ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32762024-11-14T06:19:37.653ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32772024-11-14T06:19:37.653ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32782024-11-14T06:19:37.653ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32792024-11-14T06:19:37.656ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32802024-11-14T06:19:37.656ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32812024-11-14T06:19:37.659ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32822024-11-14T06:19:37.659ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32832024-11-14T06:19:37.662ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32842024-11-14T06:19:37.662ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32852024-11-14T06:19:37.664ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32862024-11-14T06:19:37.667ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32872024-11-14T06:19:37.667ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32882024-11-14T06:19:37.667ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32892024-11-14T06:19:37.669ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32902024-11-14T06:19:37.669ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32912024-11-14T06:19:37.673ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32922024-11-14T06:19:37.673ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32932024-11-14T06:19:37.675ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32942024-11-14T06:19:37.676ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32952024-11-14T06:19:37.678ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32962024-11-14T06:19:37.678ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32972024-11-14T06:19:37.681ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
32982024-11-14T06:19:37.681ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
32992024-11-14T06:19:37.683ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
33002024-11-14T06:19:37.685ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
33012024-11-14T06:19:37.685ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33022024-11-14T06:19:37.685ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3c0d08cc-2074-4012-8f24-ad50d072de05", "date": "Thu, 14 Nov 2024 06:19:37 GMT"} })
33032024-11-14T06:19:37.685ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33042024-11-14T06:19:37.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33052024-11-14T06:19:37.686ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") }, key: 05c0df51-547f-4ce7-9356-93378cd05c2d, lookup_type: ById(05c0df51-547f-4ce7-9356-93378cd05c2d) } result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
33062024-11-14T06:19:37.686ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
33072024-11-14T06:19:37.686ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
33082024-11-14T06:19:37.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33092024-11-14T06:19:37.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33102024-11-14T06:19:37.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33112024-11-14T06:19:37.691ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
33122024-11-14T06:19:37.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33132024-11-14T06:19:37.692ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
33142024-11-14T06:19:37.694ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33152024-11-14T06:19:37.694ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33162024-11-14T06:19:37.695ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8017729e-1a22-49c0-b1ac-9dee846d5c43", "date": "Thu, 14 Nov 2024 06:19:37 GMT"} })
33172024-11-14T06:19:37.695ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
33182024-11-14T06:19:37.696ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
33192024-11-14T06:19:37.697ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 121.662375ms iteration = 2 status = {}
33202024-11-14T06:19:37.698ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
33212024-11-14T06:19:37.698ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
33222024-11-14T06:19:37.700ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
33232024-11-14T06:19:37.701ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
33242024-11-14T06:19:37.703ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
33252024-11-14T06:19:37.703ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
33262024-11-14T06:19:37.706ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
33272024-11-14T06:19:37.706ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
33282024-11-14T06:19:37.707ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
33292024-11-14T06:19:37.710ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") }, key: 3c767a11-4d93-4a48-9ca8-576b1fa99839, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
33302024-11-14T06:19:37.710ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-4b3f61ae887
33312024-11-14T06:19:37.710ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-4b3f61ae887
33322024-11-14T06:19:37.715ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138734 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = 4e02ce41-ebe5-4f56-a6d6-574fbd755a2f response_code = 204 uri = /v1/vpcs/default?project=proj-4b3f61ae887
33332024-11-14T06:19:37.716ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33342024-11-14T06:19:37.716ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33352024-11-14T06:19:37.717ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33362024-11-14T06:19:37.718ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33372024-11-14T06:19:37.719ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33382024-11-14T06:19:37.720ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("token = \\"de356d6c0a5ef48397a87a714d15c317ed296def\\"") } result = Ok(())
33392024-11-14T06:19:37.720ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33402024-11-14T06:19:37.720ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33412024-11-14T06:19:37.721ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33422024-11-14T06:19:37.722ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33432024-11-14T06:19:37.723ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33442024-11-14T06:19:37.723ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33452024-11-14T06:19:37.726ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33462024-11-14T06:19:37.726ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33472024-11-14T06:19:37.730ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33482024-11-14T06:19:37.731ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
33492024-11-14T06:19:37.731ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33502024-11-14T06:19:37.731ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33512024-11-14T06:19:37.733ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33522024-11-14T06:19:37.734ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "de356d6c0a5ef48397a87a714d15c317ed296def", lookup_type: ByCompositeId("de356d6c0a5ef48397a87a714d15c317ed296def") } result = Ok(())
33532024-11-14T06:19:37.734ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33542024-11-14T06:19:37.734ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33552024-11-14T06:19:37.738ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33562024-11-14T06:19:37.738ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33572024-11-14T06:19:37.739ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33582024-11-14T06:19:37.739ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33592024-11-14T06:19:37.741ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33602024-11-14T06:19:37.741ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33612024-11-14T06:19:37.742ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33622024-11-14T06:19:37.742ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33632024-11-14T06:19:37.744ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33642024-11-14T06:19:37.745ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: 304f7891-1445-4291-9596-038d243131a2, lookup_type: ById(304f7891-1445-4291-9596-038d243131a2) } result = Ok(())
33652024-11-14T06:19:37.745ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33662024-11-14T06:19:37.745ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33672024-11-14T06:19:37.746ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33682024-11-14T06:19:37.747ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33692024-11-14T06:19:37.748ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33702024-11-14T06:19:37.748ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33712024-11-14T06:19:37.749ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33722024-11-14T06:19:37.750ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) } result = Ok(())
33732024-11-14T06:19:37.751ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
33742024-11-14T06:19:37.751ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33752024-11-14T06:19:37.752ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
33762024-11-14T06:19:37.752ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33772024-11-14T06:19:37.753ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
33782024-11-14T06:19:37.754ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33792024-11-14T06:19:37.756ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
33802024-11-14T06:19:37.756ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33812024-11-14T06:19:37.758ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
33822024-11-14T06:19:37.758ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33832024-11-14T06:19:37.760ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
33842024-11-14T06:19:37.760ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33852024-11-14T06:19:37.763ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/projects/proj-4b3f61ae887
33862024-11-14T06:19:37.765ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") } result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33872024-11-14T06:19:37.765ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
33882024-11-14T06:19:37.765ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33892024-11-14T06:19:37.767ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
33902024-11-14T06:19:37.768ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33912024-11-14T06:19:37.770ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
33922024-11-14T06:19:37.770ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33932024-11-14T06:19:37.772ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
33942024-11-14T06:19:37.772ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33952024-11-14T06:19:37.774ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {(Silo, 95153e51-68aa-4bd4-8e65-b8164172811d, "admin")} } uri = /v1/projects/proj-4b3f61ae887
33962024-11-14T06:19:37.776ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Project { parent: Silo { parent: Fleet, key: 95153e51-68aa-4bd4-8e65-b8164172811d, lookup_type: ById(95153e51-68aa-4bd4-8e65-b8164172811d) }, key: b0405cbf-13e7-4232-9a3b-a3f51db78bbf, lookup_type: ByName("proj-4b3f61ae887") } result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33972024-11-14T06:19:37.776ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
33982024-11-14T06:19:37.776ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
33992024-11-14T06:19:37.778ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
34002024-11-14T06:19:37.778ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
34012024-11-14T06:19:37.780ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
34022024-11-14T06:19:37.781ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
34032024-11-14T06:19:37.791ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
34042024-11-14T06:19:37.791ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
34052024-11-14T06:19:37.862ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
34062024-11-14T06:19:37.863ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
34072024-11-14T06:19:37.870ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
34082024-11-14T06:19:37.870ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
34092024-11-14T06:19:37.872ZDEBGnexus (dropshot_external): roles actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 roles = RoleSet { roles: {} } uri = /v1/projects/proj-4b3f61ae887
34102024-11-14T06:19:37.873ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 304f7891-1445-4291-9596-038d243131a2, silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, .. }) actor_id = 304f7891-1445-4291-9596-038d243131a2 authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 resource = Database result = Ok(()) uri = /v1/projects/proj-4b3f61ae887
34112024-11-14T06:19:37.881ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165528 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:35025 req_id = f12baa42-2a15-42ae-8fce-77aefa36a126 response_code = 204 uri = /v1/projects/proj-4b3f61ae887
34122024-11-14T06:19:39.386ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
34132024-11-14T06:19:39.386ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34142024-11-14T06:19:39.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
34152024-11-14T06:19:39.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34162024-11-14T06:19:39.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34172024-11-14T06:19:39.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34182024-11-14T06:19:39.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34192024-11-14T06:19:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34202024-11-14T06:19:39.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34212024-11-14T06:19:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34222024-11-14T06:19:39.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34232024-11-14T06:19:39.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34242024-11-14T06:19:39.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34252024-11-14T06:19:39.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
34262024-11-14T06:19:39.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34272024-11-14T06:19:39.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34282024-11-14T06:19:39.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34292024-11-14T06:19:39.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34302024-11-14T06:19:39.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.796936ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34312024-11-14T06:19:39.470ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
34322024-11-14T06:19:39.470ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.546555ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z","time_found":"2024-11-14T06:19:39.470472568Z"}
34332024-11-14T06:19:39.470ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
34342024-11-14T06:19:39.470ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
34352024-11-14T06:19:39.470ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
34362024-11-14T06:19:39.470ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 7.52\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
34372024-11-14T06:19:39.470ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34382024-11-14T06:19:39.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34392024-11-14T06:19:39.470ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34402024-11-14T06:19:39.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34412024-11-14T06:19:39.471ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34422024-11-14T06:19:39.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34432024-11-14T06:19:39.471ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34442024-11-14T06:19:39.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34452024-11-14T06:19:39.471ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34462024-11-14T06:19:39.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34472024-11-14T06:19:39.473ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34482024-11-14T06:19:39.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34492024-11-14T06:19:39.474ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34502024-11-14T06:19:39.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34512024-11-14T06:19:39.475ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34522024-11-14T06:19:39.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34532024-11-14T06:19:39.476ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34542024-11-14T06:19:39.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34552024-11-14T06:19:39.476ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34562024-11-14T06:19:39.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34572024-11-14T06:19:39.478ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34582024-11-14T06:19:39.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34592024-11-14T06:19:39.478ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34602024-11-14T06:19:39.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34612024-11-14T06:19:39.479ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34622024-11-14T06:19:39.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34632024-11-14T06:19:39.480ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34642024-11-14T06:19:39.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34652024-11-14T06:19:39.481ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34662024-11-14T06:19:39.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34672024-11-14T06:19:39.520ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
34682024-11-14T06:19:39.551ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
34692024-11-14T06:19:39.581ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
34702024-11-14T06:19:39.615ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
34712024-11-14T06:19:39.650ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
34722024-11-14T06:19:40.508ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb394049-8a27-43f6-af8c-3ac5750b0e2c", "content-length": "64", "date": "Thu, 14 Nov 2024 06:19:39 GMT"} })
34732024-11-14T06:19:40.508ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34742024-11-14T06:19:40.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34752024-11-14T06:19:40.509ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34762024-11-14T06:19:40.511ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34772024-11-14T06:19:40.511ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34782024-11-14T06:19:40.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34792024-11-14T06:19:40.560ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4b105ae-3557-457a-bd6a-486ab40c3183", "content-length": "64", "date": "Thu, 14 Nov 2024 06:19:39 GMT"} })
34802024-11-14T06:19:40.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34812024-11-14T06:19:40.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34822024-11-14T06:19:40.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34832024-11-14T06:19:40.564ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34842024-11-14T06:19:40.564ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34852024-11-14T06:19:40.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34862024-11-14T06:19:40.581ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a470957-6795-4633-97db-d84ac8cdcb32", "content-length": "64", "date": "Thu, 14 Nov 2024 06:19:40 GMT"} })
34872024-11-14T06:19:40.581ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34882024-11-14T06:19:40.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34892024-11-14T06:19:40.583ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34902024-11-14T06:19:40.584ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34912024-11-14T06:19:40.584ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34922024-11-14T06:19:40.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34932024-11-14T06:19:40.585ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b5fd36e-5154-4a4a-9687-a4d1ecd0e80e", "content-length": "64", "date": "Thu, 14 Nov 2024 06:19:39 GMT"} })
34942024-11-14T06:19:40.585ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34952024-11-14T06:19:40.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34962024-11-14T06:19:40.587ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34972024-11-14T06:19:40.588ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34982024-11-14T06:19:40.588ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34992024-11-14T06:19:40.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
35002024-11-14T06:19:42.644ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:50471 remote_addr = [fd00:1122:3344:101::d]:51900
35012024-11-14T06:19:42.645ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = b3c206bd-21da-4169-835a-a12f442fb85f response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
35022024-11-14T06:19:49.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
35032024-11-14T06:19:49.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35042024-11-14T06:19:49.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
35052024-11-14T06:19:49.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35062024-11-14T06:19:49.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35072024-11-14T06:19:49.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35082024-11-14T06:19:49.389ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35092024-11-14T06:19:49.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35102024-11-14T06:19:49.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35112024-11-14T06:19:49.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.586525ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35122024-11-14T06:19:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35132024-11-14T06:19:49.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35142024-11-14T06:19:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35152024-11-14T06:19:49.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35162024-11-14T06:19:49.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35172024-11-14T06:19:49.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35182024-11-14T06:19:49.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
35192024-11-14T06:19:49.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35202024-11-14T06:19:49.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35212024-11-14T06:19:49.413ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
35222024-11-14T06:19:49.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.223428ms iteration = 3 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
35232024-11-14T06:19:52.644ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1214 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 5a572a1c-be7c-4433-b09b-7dcf7e4cb8bf response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
35242024-11-14T06:19:54.650ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::6]:32222/node/id", source: TimedOut })
35252024-11-14T06:19:54.654ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 15.184301685s iteration = 2 status = {"errors":[{"err":"failed to fetch node ID for zone bbd2de20-0068-44d9-8d0d-469be6553e52 at http://[fd00:1122:3344:101::6]:32222: Communication Error: error sending request for url (http://[fd00:1122:3344:101::6]:32222/node/id): error sending request for url (http://[fd00:1122:3344:101::6]:32222/node/id): operation timed out","zone_id":"bbd2de20-0068-44d9-8d0d-469be6553e52"}],"nsuccess":4}
35262024-11-14T06:19:57.593ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:40729
35272024-11-14T06:19:57.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 74174fcd-157b-4b95-a391-2931a889e624 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
35282024-11-14T06:19:57.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 74174fcd-157b-4b95-a391-2931a889e624 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
35292024-11-14T06:19:57.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 74174fcd-157b-4b95-a391-2931a889e624 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
35302024-11-14T06:19:57.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 30c2de52-e005-4038-8e44-100325f6dd30 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI2ZTgxYTI5YS05NTY2LTRmMzAtOGMyYi0wNDZmYmJkOTlkZmEifX0%3D
35312024-11-14T06:19:57.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 30c2de52-e005-4038-8e44-100325f6dd30 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI2ZTgxYTI5YS05NTY2LTRmMzAtOGMyYi0wNDZmYmJkOTlkZmEifX0%3D
35322024-11-14T06:19:57.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 30c2de52-e005-4038-8e44-100325f6dd30 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI2ZTgxYTI5YS05NTY2LTRmMzAtOGMyYi0wNDZmYmJkOTlkZmEifX0%3D
35332024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
35342024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35352024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
35362024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35372024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
35382024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
35392024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35402024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35412024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
35422024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
35432024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35442024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
35452024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35462024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35472024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
35482024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35492024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
35502024-11-14T06:19:59.386ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35512024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35522024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
35532024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35542024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
35552024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
35562024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35572024-11-14T06:19:59.387ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35582024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
35592024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35602024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35612024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
35622024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
35632024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35642024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
35652024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
35662024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35672024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35682024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35692024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35702024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35712024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35722024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35732024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35742024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35752024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35762024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35772024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35782024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35792024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35802024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35812024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35822024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35832024-11-14T06:19:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35842024-11-14T06:19:59.392ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1055, tv_nsec: 955502913 } })
35852024-11-14T06:19:59.393ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
35862024-11-14T06:19:59.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35872024-11-14T06:19:59.396ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1055, tv_nsec: 959485158 } })
35882024-11-14T06:19:59.396ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
35892024-11-14T06:19:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35902024-11-14T06:19:59.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35912024-11-14T06:19:59.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35922024-11-14T06:19:59.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35932024-11-14T06:19:59.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35942024-11-14T06:19:59.412ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 25.537596ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35952024-11-14T06:19:59.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35962024-11-14T06:19:59.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35972024-11-14T06:19:59.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35982024-11-14T06:19:59.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35992024-11-14T06:19:59.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36002024-11-14T06:19:59.447ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36012024-11-14T06:19:59.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36022024-11-14T06:19:59.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36032024-11-14T06:19:59.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.536886ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
36042024-11-14T06:19:59.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.694116ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
36052024-11-14T06:19:59.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36062024-11-14T06:19:59.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36072024-11-14T06:19:59.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36082024-11-14T06:19:59.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36092024-11-14T06:19:59.456ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36102024-11-14T06:19:59.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36112024-11-14T06:19:59.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36122024-11-14T06:19:59.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36132024-11-14T06:19:59.459ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36142024-11-14T06:19:59.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36152024-11-14T06:19:59.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36162024-11-14T06:19:59.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36172024-11-14T06:19:59.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36182024-11-14T06:19:59.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36192024-11-14T06:19:59.465ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
36202024-11-14T06:19:59.465ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36212024-11-14T06:19:59.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36222024-11-14T06:19:59.465ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e72dcfc5-8100-4e02-9099-de60dd74349c", "content-length": "26", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
36232024-11-14T06:19:59.465ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36242024-11-14T06:19:59.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36252024-11-14T06:19:59.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36262024-11-14T06:19:59.466ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36272024-11-14T06:19:59.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36282024-11-14T06:19:59.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36292024-11-14T06:19:59.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36302024-11-14T06:19:59.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36312024-11-14T06:19:59.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
36322024-11-14T06:19:59.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36332024-11-14T06:19:59.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36342024-11-14T06:19:59.470ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1056, tv_nsec: 33655678 } })
36352024-11-14T06:19:59.471ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
36362024-11-14T06:19:59.471ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
36372024-11-14T06:19:59.471ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36382024-11-14T06:19:59.471ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "94aa8064-c51e-4adc-af9a-c1fa720b321d", "content-length": "26", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
36392024-11-14T06:19:59.471ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36402024-11-14T06:19:59.473ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36412024-11-14T06:19:59.485ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
36422024-11-14T06:19:59.485ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.711057ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
36432024-11-14T06:19:59.504ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36442024-11-14T06:19:59.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36452024-11-14T06:19:59.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36462024-11-14T06:19:59.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36472024-11-14T06:19:59.508ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36482024-11-14T06:19:59.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36492024-11-14T06:19:59.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36502024-11-14T06:19:59.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36512024-11-14T06:19:59.518ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36522024-11-14T06:19:59.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36532024-11-14T06:19:59.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36542024-11-14T06:19:59.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
36552024-11-14T06:19:59.526ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36562024-11-14T06:19:59.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36572024-11-14T06:19:59.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36582024-11-14T06:19:59.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36592024-11-14T06:19:59.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36602024-11-14T06:19:59.532ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36612024-11-14T06:19:59.532ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 145.951957ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36622024-11-14T06:19:59.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36632024-11-14T06:19:59.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 147.481414ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36642024-11-14T06:19:59.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36652024-11-14T06:19:59.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36662024-11-14T06:19:59.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36672024-11-14T06:19:59.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36682024-11-14T06:19:59.544ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36692024-11-14T06:19:59.544ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36702024-11-14T06:19:59.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36712024-11-14T06:19:59.544ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36722024-11-14T06:19:59.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36732024-11-14T06:19:59.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 157.468581ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36742024-11-14T06:19:59.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36752024-11-14T06:19:59.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36762024-11-14T06:19:59.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36772024-11-14T06:19:59.547ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36782024-11-14T06:19:59.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36792024-11-14T06:19:59.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36802024-11-14T06:19:59.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36812024-11-14T06:19:59.564ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36822024-11-14T06:19:59.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36832024-11-14T06:19:59.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36842024-11-14T06:19:59.569ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36852024-11-14T06:19:59.569ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36862024-11-14T06:19:59.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36872024-11-14T06:19:59.571ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36882024-11-14T06:19:59.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36892024-11-14T06:19:59.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36902024-11-14T06:19:59.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36912024-11-14T06:19:59.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36922024-11-14T06:19:59.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36932024-11-14T06:19:59.585ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 198.857581ms iteration = 2 status = {}
36942024-11-14T06:19:59.585ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
36952024-11-14T06:19:59.586ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36962024-11-14T06:19:59.586ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36972024-11-14T06:19:59.586ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36982024-11-14T06:19:59.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36992024-11-14T06:19:59.586ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "253146d2-42f4-4bf1-95f0-490aa77f5c62", "content-length": "26", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37002024-11-14T06:19:59.586ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37012024-11-14T06:19:59.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37022024-11-14T06:19:59.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 201.184924ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
37032024-11-14T06:19:59.588ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
37042024-11-14T06:19:59.589ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37052024-11-14T06:19:59.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37062024-11-14T06:19:59.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37072024-11-14T06:19:59.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37082024-11-14T06:19:59.621ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37092024-11-14T06:19:59.622ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37102024-11-14T06:19:59.622ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f86b7613-063a-469f-b950-a9bda8517061", "content-length": "372", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37112024-11-14T06:19:59.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37122024-11-14T06:19:59.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37132024-11-14T06:19:59.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37142024-11-14T06:19:59.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37152024-11-14T06:19:59.648ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37162024-11-14T06:19:59.649ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "568bcfc9-7a72-48b9-91b1-3d401a0cafbc", "content-length": "1", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37172024-11-14T06:19:59.650ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37182024-11-14T06:19:59.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37192024-11-14T06:19:59.651ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37202024-11-14T06:19:59.651ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37212024-11-14T06:19:59.651ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 264.571715ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37222024-11-14T06:19:59.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 274.55489ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
37232024-11-14T06:19:59.670ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37242024-11-14T06:19:59.671ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "63cc0c9c-2bdf-4c72-9ea1-78b0c0e58374", "content-length": "691", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37252024-11-14T06:19:59.671ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37262024-11-14T06:19:59.671ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37272024-11-14T06:19:59.671ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37282024-11-14T06:19:59.672ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 285.84978ms iteration = 4 status = {"physical_disks_added":0}
37292024-11-14T06:19:59.673ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 286.601364ms iteration = 2 status = {}
37302024-11-14T06:19:59.675ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1056, tv_nsec: 238185115 } })
37312024-11-14T06:19:59.675ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1131
37322024-11-14T06:19:59.677ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 290.156321ms iteration = 2 status = null
37332024-11-14T06:19:59.737ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
37342024-11-14T06:19:59.737ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37352024-11-14T06:19:59.738ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02cc75c7-e304-47e4-be0d-05ea494d06f2", "content-length": "26", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37362024-11-14T06:19:59.738ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37372024-11-14T06:19:59.739ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37382024-11-14T06:19:59.745ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
37392024-11-14T06:19:59.745ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37402024-11-14T06:19:59.746ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8cc572a9-d881-4a4a-b9fb-e2da9ee5ee83", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37412024-11-14T06:19:59.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37422024-11-14T06:19:59.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37432024-11-14T06:19:59.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37442024-11-14T06:19:59.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37452024-11-14T06:19:59.753ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37462024-11-14T06:19:59.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37472024-11-14T06:19:59.757ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37482024-11-14T06:19:59.757ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37492024-11-14T06:19:59.758ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3a6d4df2-c37b-40f6-bb83-de35257dd36a", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37502024-11-14T06:19:59.759ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 372.459303ms iteration = 3 status = {}
37512024-11-14T06:19:59.802ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
37522024-11-14T06:19:59.802ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f74fe1c-7e73-43fd-acd7-9a71bedf7015", "content-length": "4", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37532024-11-14T06:19:59.804ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 417.181575ms iteration = 2 status = 6
37542024-11-14T06:19:59.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37552024-11-14T06:19:59.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37562024-11-14T06:19:59.817ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
37572024-11-14T06:19:59.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37582024-11-14T06:19:59.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37592024-11-14T06:19:59.833ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37602024-11-14T06:19:59.833ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d480658b-e689-4c14-8427-5147ce77f6db", "content-length": "134", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37612024-11-14T06:19:59.833ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37622024-11-14T06:19:59.833ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
37632024-11-14T06:19:59.836ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {}}
37642024-11-14T06:19:59.836ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37652024-11-14T06:19:59.836ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37662024-11-14T06:19:59.836ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {}
37672024-11-14T06:19:59.836ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37682024-11-14T06:19:59.836ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37692024-11-14T06:19:59.838ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
37702024-11-14T06:19:59.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37712024-11-14T06:19:59.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37722024-11-14T06:19:59.844ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37732024-11-14T06:19:59.844ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7816d8c-441d-499d-96b2-3c438d0b20fa", "content-length": "2", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37742024-11-14T06:19:59.844ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37752024-11-14T06:19:59.845ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf9bc5d7-291b-4f48-874e-8d061177fd61", "content-length": "52", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37762024-11-14T06:19:59.845ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
37772024-11-14T06:19:59.845ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37782024-11-14T06:20:00.172ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "db5cc0dd-0056-40f9-83bb-1d9c2ab0b62c", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37792024-11-14T06:20:00.172ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
37802024-11-14T06:20:00.172ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37812024-11-14T06:20:00.173ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "58a243f7-3af3-41c8-9ac5-d8625d489b98", "content-length": "682", "date": "Thu, 14 Nov 2024 06:19:59 GMT"} })
37822024-11-14T06:20:00.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37832024-11-14T06:20:00.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37842024-11-14T06:20:00.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37852024-11-14T06:20:00.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37862024-11-14T06:20:00.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37872024-11-14T06:20:00.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37882024-11-14T06:20:00.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37892024-11-14T06:20:00.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37902024-11-14T06:20:00.192ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 805.196667ms iteration = 2 status = {}
37912024-11-14T06:20:07.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1166 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = ee40ab86-86a9-4df5-95e2-11bea696a552 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
37922024-11-14T06:20:09.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
37932024-11-14T06:20:09.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37942024-11-14T06:20:09.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
37952024-11-14T06:20:09.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37962024-11-14T06:20:09.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37972024-11-14T06:20:09.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37982024-11-14T06:20:09.388ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37992024-11-14T06:20:09.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38002024-11-14T06:20:09.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38012024-11-14T06:20:09.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.84613ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38022024-11-14T06:20:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38032024-11-14T06:20:09.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38042024-11-14T06:20:09.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38052024-11-14T06:20:09.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38062024-11-14T06:20:09.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38072024-11-14T06:20:09.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38082024-11-14T06:20:09.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
38092024-11-14T06:20:09.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38102024-11-14T06:20:09.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38112024-11-14T06:20:09.411ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
38122024-11-14T06:20:09.411ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.054558ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
38132024-11-14T06:20:19.386ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
38142024-11-14T06:20:19.386ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38152024-11-14T06:20:19.386ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
38162024-11-14T06:20:19.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38172024-11-14T06:20:19.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38182024-11-14T06:20:19.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38192024-11-14T06:20:19.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38202024-11-14T06:20:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38212024-11-14T06:20:19.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38222024-11-14T06:20:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38232024-11-14T06:20:19.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38242024-11-14T06:20:19.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38252024-11-14T06:20:19.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38262024-11-14T06:20:19.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
38272024-11-14T06:20:19.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38282024-11-14T06:20:19.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38292024-11-14T06:20:19.408ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
38302024-11-14T06:20:19.408ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.654253ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
38312024-11-14T06:20:19.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38322024-11-14T06:20:19.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38332024-11-14T06:20:19.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.670635ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38342024-11-14T06:20:22.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1167 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = bed678aa-ce6d-433b-94c7-801ee05b3ccc response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
38352024-11-14T06:20:29.386ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
38362024-11-14T06:20:29.386ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
38372024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38382024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38392024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
38402024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38412024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38422024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
38432024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
38442024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
38452024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
38462024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
38472024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
38482024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38492024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
38502024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38512024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38522024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
38532024-11-14T06:20:29.387ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
38542024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.39\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
38552024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
38562024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
38572024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
38582024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38592024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
38602024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
38612024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38622024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
38632024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38642024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38652024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
38662024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38672024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
38682024-11-14T06:20:29.387ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:10:29.387156066 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38692024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38702024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
38712024-11-14T06:20:29.387ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
38722024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38732024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
38742024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38752024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
38762024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
38772024-11-14T06:20:29.387ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38782024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38792024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38802024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
38812024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38822024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
38832024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38842024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
38852024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38862024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
38872024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
38882024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38892024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
38902024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
38912024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38922024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
38932024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
38942024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
38952024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
38962024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38972024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38982024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38992024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39002024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39012024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39022024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39032024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39042024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39052024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39062024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39072024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39082024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39092024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39102024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39112024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39122024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39132024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39142024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39152024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39162024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39172024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39182024-11-14T06:20:29.387ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1085, tv_nsec: 950625932 } })
39192024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39202024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39212024-11-14T06:20:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39222024-11-14T06:20:29.388ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1085, tv_nsec: 950700754 } })
39232024-11-14T06:20:29.388ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39242024-11-14T06:20:29.388ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.054789ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
39252024-11-14T06:20:29.388ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
39262024-11-14T06:20:29.388ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.417307ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
39272024-11-14T06:20:29.391ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1085, tv_nsec: 954112748 } })
39282024-11-14T06:20:29.391ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
39292024-11-14T06:20:29.391ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.647376ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39302024-11-14T06:20:29.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39312024-11-14T06:20:29.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39322024-11-14T06:20:29.393ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39332024-11-14T06:20:29.394ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.632152ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
39342024-11-14T06:20:29.394ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39352024-11-14T06:20:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39362024-11-14T06:20:29.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39372024-11-14T06:20:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39382024-11-14T06:20:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39392024-11-14T06:20:29.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39402024-11-14T06:20:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39412024-11-14T06:20:29.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39422024-11-14T06:20:29.396ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39432024-11-14T06:20:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39442024-11-14T06:20:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39452024-11-14T06:20:29.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39462024-11-14T06:20:29.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39472024-11-14T06:20:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39482024-11-14T06:20:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39492024-11-14T06:20:29.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39502024-11-14T06:20:29.399ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:10:29.387156066 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39512024-11-14T06:20:29.399ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.044284ms iteration = 2 status = {"expiration":"2024-11-14T06:10:29.387156066Z","pruned":[]}
39522024-11-14T06:20:29.399ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39532024-11-14T06:20:29.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39542024-11-14T06:20:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39552024-11-14T06:20:29.401ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39562024-11-14T06:20:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39572024-11-14T06:20:29.403ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39582024-11-14T06:20:29.406ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39592024-11-14T06:20:29.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
39602024-11-14T06:20:29.407ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39612024-11-14T06:20:29.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39622024-11-14T06:20:29.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39632024-11-14T06:20:29.408ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39642024-11-14T06:20:29.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39652024-11-14T06:20:29.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39662024-11-14T06:20:29.409ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39672024-11-14T06:20:29.411ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39682024-11-14T06:20:29.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39692024-11-14T06:20:29.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39702024-11-14T06:20:29.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39712024-11-14T06:20:29.411ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39722024-11-14T06:20:29.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39732024-11-14T06:20:29.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39742024-11-14T06:20:29.414ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39752024-11-14T06:20:29.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39762024-11-14T06:20:29.415ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1085, tv_nsec: 978010612 } })
39772024-11-14T06:20:29.415ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39782024-11-14T06:20:29.415ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
39792024-11-14T06:20:29.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39802024-11-14T06:20:29.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39812024-11-14T06:20:29.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39822024-11-14T06:20:29.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39832024-11-14T06:20:29.420ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39842024-11-14T06:20:29.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39852024-11-14T06:20:29.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862024-11-14T06:20:29.424ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39872024-11-14T06:20:29.425ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39882024-11-14T06:20:29.425ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39892024-11-14T06:20:29.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39902024-11-14T06:20:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
39912024-11-14T06:20:29.428ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39922024-11-14T06:20:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39932024-11-14T06:20:29.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39942024-11-14T06:20:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39952024-11-14T06:20:29.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39962024-11-14T06:20:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
39972024-11-14T06:20:29.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39982024-11-14T06:20:29.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39992024-11-14T06:20:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40002024-11-14T06:20:29.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40012024-11-14T06:20:29.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40022024-11-14T06:20:29.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40032024-11-14T06:20:29.464ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.992103ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
40042024-11-14T06:20:29.475ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40052024-11-14T06:20:29.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40062024-11-14T06:20:29.480ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40072024-11-14T06:20:29.480ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40082024-11-14T06:20:29.480ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.754905ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40092024-11-14T06:20:29.481ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40102024-11-14T06:20:29.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40112024-11-14T06:20:29.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.590465ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40122024-11-14T06:20:29.487ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40132024-11-14T06:20:29.487ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40142024-11-14T06:20:29.487ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40152024-11-14T06:20:29.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40162024-11-14T06:20:29.488ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40172024-11-14T06:20:29.488ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 100.922819ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40182024-11-14T06:20:29.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40192024-11-14T06:20:29.488ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
40202024-11-14T06:20:29.488ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
40212024-11-14T06:20:29.488ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 100.917709ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
40222024-11-14T06:20:29.490ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.982437ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40232024-11-14T06:20:29.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 109.155561ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
40242024-11-14T06:20:29.497ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40252024-11-14T06:20:29.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40262024-11-14T06:20:29.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40272024-11-14T06:20:29.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40282024-11-14T06:20:29.509ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1086, tv_nsec: 72040563 } })
40292024-11-14T06:20:29.509ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
40302024-11-14T06:20:29.548ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40312024-11-14T06:20:29.548ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40322024-11-14T06:20:29.548ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40332024-11-14T06:20:29.548ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:46283
40342024-11-14T06:20:29.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46283 req_id = b85f1f39-3ad9-4733-9d81-9ab4a69dc315 roles = RoleSet { roles: {} } uri = /metrics/producers
40352024-11-14T06:20:29.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40362024-11-14T06:20:29.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46283 req_id = b85f1f39-3ad9-4733-9d81-9ab4a69dc315 resource = Database result = Ok(()) uri = /metrics/producers
40372024-11-14T06:20:29.550ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
40382024-11-14T06:20:29.550ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40392024-11-14T06:20:29.550ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40402024-11-14T06:20:29.550ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40412024-11-14T06:20:29.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40422024-11-14T06:20:29.554ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40432024-11-14T06:20:29.592ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40442024-11-14T06:20:29.592ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40452024-11-14T06:20:29.592ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5cdf060-4662-4854-b7df-dfe56ece075c", "content-length": "372", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} })
40462024-11-14T06:20:29.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40472024-11-14T06:20:29.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40482024-11-14T06:20:29.605ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40492024-11-14T06:20:29.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40502024-11-14T06:20:29.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40512024-11-14T06:20:29.613ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
40522024-11-14T06:20:29.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40532024-11-14T06:20:29.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40542024-11-14T06:20:29.613ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 226.447535ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
40552024-11-14T06:20:29.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40562024-11-14T06:20:29.614ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
40572024-11-14T06:20:29.614ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 227.194649ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
40582024-11-14T06:20:29.614ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40592024-11-14T06:20:29.614ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40602024-11-14T06:20:29.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40612024-11-14T06:20:29.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40622024-11-14T06:20:29.618ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40632024-11-14T06:20:29.618ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40642024-11-14T06:20:29.618ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 231.522469ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40652024-11-14T06:20:29.623ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40662024-11-14T06:20:29.623ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
40672024-11-14T06:20:29.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40682024-11-14T06:20:29.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40692024-11-14T06:20:29.629ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40702024-11-14T06:20:29.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40712024-11-14T06:20:29.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40722024-11-14T06:20:29.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40732024-11-14T06:20:29.634ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
40742024-11-14T06:20:29.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40752024-11-14T06:20:29.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40762024-11-14T06:20:29.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40772024-11-14T06:20:29.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40782024-11-14T06:20:29.650ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
40792024-11-14T06:20:29.650ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
40802024-11-14T06:20:29.650ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
40812024-11-14T06:20:29.650ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 263.341531ms iteration = 3 status = {"generation":2}
40822024-11-14T06:20:29.660ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
40832024-11-14T06:20:29.660ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40842024-11-14T06:20:29.660ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba362bef-542b-4bcb-a8f1-62e48fbc76f6", "content-length": "26", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} })
40852024-11-14T06:20:29.660ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40862024-11-14T06:20:29.662ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
40872024-11-14T06:20:29.662ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 275.343135ms iteration = 5 status = {"physical_disks_added":0}
40882024-11-14T06:20:29.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40892024-11-14T06:20:29.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40902024-11-14T06:20:29.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40912024-11-14T06:20:29.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40922024-11-14T06:20:29.669ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40932024-11-14T06:20:29.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40942024-11-14T06:20:29.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40952024-11-14T06:20:29.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 299.010755ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40962024-11-14T06:20:29.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 299.179638ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40972024-11-14T06:20:29.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40982024-11-14T06:20:29.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40992024-11-14T06:20:29.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41002024-11-14T06:20:29.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41012024-11-14T06:20:29.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
41022024-11-14T06:20:29.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41032024-11-14T06:20:29.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41042024-11-14T06:20:29.703ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 315.792397ms iteration = 3 status = 0
41052024-11-14T06:20:29.704ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 07d948d3-6a47-45eb-9ed3-629b45d23b8a
41062024-11-14T06:20:29.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155392 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46283 req_id = b85f1f39-3ad9-4733-9d81-9ab4a69dc315 response_code = 201 uri = /metrics/producers
41072024-11-14T06:20:29.710ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
41082024-11-14T06:20:29.710ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41092024-11-14T06:20:29.711ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "186a4e6a-1f23-443f-9a05-7eef3e45c80d", "content-length": "26", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} })
41102024-11-14T06:20:29.711ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41112024-11-14T06:20:29.713ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
41122024-11-14T06:20:29.713ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41132024-11-14T06:20:29.713ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41142024-11-14T06:20:29.713ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e5aa5c25-c776-4b8c-8125-b2469106f371", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} })
41152024-11-14T06:20:29.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41162024-11-14T06:20:29.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41172024-11-14T06:20:29.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41182024-11-14T06:20:29.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41192024-11-14T06:20:29.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41202024-11-14T06:20:29.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41212024-11-14T06:20:29.729ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41222024-11-14T06:20:29.729ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41232024-11-14T06:20:29.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41242024-11-14T06:20:29.729ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
41252024-11-14T06:20:29.729ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 342.642957ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41262024-11-14T06:20:29.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41272024-11-14T06:20:29.731ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41282024-11-14T06:20:29.731ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41292024-11-14T06:20:29.732ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ca51fcdc-306d-46d5-8173-51ada87339a6", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} })
41302024-11-14T06:20:29.733ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 346.511429ms iteration = 4 status = {}
41312024-11-14T06:20:29.739ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
41322024-11-14T06:20:29.739ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41332024-11-14T06:20:29.739ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d28d05f-63d9-44b4-8dd2-00ab83b76815", "content-length": "26", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} })
41342024-11-14T06:20:29.739ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41352024-11-14T06:20:29.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41362024-11-14T06:20:29.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41372024-11-14T06:20:29.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41382024-11-14T06:20:29.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41392024-11-14T06:20:29.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41402024-11-14T06:20:29.766ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41412024-11-14T06:20:29.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41422024-11-14T06:20:29.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41432024-11-14T06:20:29.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41442024-11-14T06:20:29.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41452024-11-14T06:20:29.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41462024-11-14T06:20:29.771ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41472024-11-14T06:20:29.772ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
41482024-11-14T06:20:29.772ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41492024-11-14T06:20:29.772ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
41502024-11-14T06:20:29.772ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 385.601737ms iteration = 3 status = {"generation":1}
41512024-11-14T06:20:29.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41522024-11-14T06:20:29.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41532024-11-14T06:20:29.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41542024-11-14T06:20:29.781ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41552024-11-14T06:20:29.782ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2e3b21b2-ba19-4a82-958e-c2b92b130bcc", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41562024-11-14T06:20:29.782ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41572024-11-14T06:20:29.783ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "78098a74-5d4f-478c-b893-dbc9040d3522", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41582024-11-14T06:20:29.783ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41592024-11-14T06:20:29.785ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41602024-11-14T06:20:29.785ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 398.603259ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41612024-11-14T06:20:29.872ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 485.293392ms iteration = 3 status = {}
41622024-11-14T06:20:29.900ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41632024-11-14T06:20:29.900ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2321458e-3f9e-4514-9e4f-88bb0a439012", "content-length": "1", "date": "Thu, 14 Nov 2024 06:20:28 GMT"} })
41642024-11-14T06:20:29.902ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41652024-11-14T06:20:29.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41662024-11-14T06:20:29.904ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 518.002151ms iteration = 3 status = null
41672024-11-14T06:20:29.953ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41682024-11-14T06:20:30.091ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41692024-11-14T06:20:30.093ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "660affb9-4bd5-4039-80b7-ed139d0ca6f5", "content-length": "691", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} })
41702024-11-14T06:20:30.093ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
41712024-11-14T06:20:30.093ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
41722024-11-14T06:20:30.093ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
41732024-11-14T06:20:30.094ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 707.402277ms iteration = 3 status = {}
41742024-11-14T06:20:30.165ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41752024-11-14T06:20:30.166ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4a9aadba-f86a-413f-9a49-89f8424451de", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
41762024-11-14T06:20:30.166ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
41772024-11-14T06:20:30.168ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "45d6f300-0619-4158-9e1f-b6eec1d30b3a", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
41782024-11-14T06:20:30.168ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
41792024-11-14T06:20:30.169ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d939beeb-ee3f-4618-9e3d-38179c32fdf9", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
41802024-11-14T06:20:30.169ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
41812024-11-14T06:20:30.171ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
41822024-11-14T06:20:30.171ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 784.327379ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
41832024-11-14T06:20:30.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41842024-11-14T06:20:30.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41852024-11-14T06:20:30.201ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
41862024-11-14T06:20:30.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41872024-11-14T06:20:30.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41882024-11-14T06:20:30.210ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41892024-11-14T06:20:30.211ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "734b076a-e886-43e2-a518-739aca62b8e5", "content-length": "134", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} })
41902024-11-14T06:20:30.211ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41912024-11-14T06:20:30.211ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
41922024-11-14T06:20:30.211ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41932024-11-14T06:20:30.211ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41942024-11-14T06:20:30.211ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41952024-11-14T06:20:30.211ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41962024-11-14T06:20:30.211ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41972024-11-14T06:20:30.211ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41982024-11-14T06:20:30.212ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41992024-11-14T06:20:30.212ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42002024-11-14T06:20:30.212ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
42012024-11-14T06:20:30.212ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42022024-11-14T06:20:30.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42032024-11-14T06:20:30.215ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42042024-11-14T06:20:30.215ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b46ef67-34f0-47ac-9e0d-da77a0038ccd", "content-length": "2", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} })
42052024-11-14T06:20:30.215ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42062024-11-14T06:20:30.215ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c16f2e3-8c2a-4a7e-9128-a82f0685cb4a", "content-length": "52", "date": "Thu, 14 Nov 2024 06:20:29 GMT"} })
42072024-11-14T06:20:30.215ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
42082024-11-14T06:20:30.215ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42092024-11-14T06:20:30.305ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1d8acd1b-4d8f-4866-ab7a-2c80ffc2c272", "date": "Thu, 14 Nov 2024 06:20:30 GMT"} })
42102024-11-14T06:20:30.305ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
42112024-11-14T06:20:30.305ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42122024-11-14T06:20:30.306ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6578c5a-9df0-4eb0-be25-a7e597caab8e", "content-length": "682", "date": "Thu, 14 Nov 2024 06:20:30 GMT"} })
42132024-11-14T06:20:30.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42142024-11-14T06:20:30.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42152024-11-14T06:20:30.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42162024-11-14T06:20:30.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42172024-11-14T06:20:30.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42182024-11-14T06:20:30.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42192024-11-14T06:20:30.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42202024-11-14T06:20:30.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42212024-11-14T06:20:30.331ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 944.093893ms iteration = 3 status = {}
42222024-11-14T06:20:37.603ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1061 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = e6301d3d-310a-4019-8490-1a65c4c9552c response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
42232024-11-14T06:20:39.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
42242024-11-14T06:20:39.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42252024-11-14T06:20:39.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
42262024-11-14T06:20:39.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42272024-11-14T06:20:39.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42282024-11-14T06:20:39.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42292024-11-14T06:20:39.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42302024-11-14T06:20:39.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42312024-11-14T06:20:39.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42322024-11-14T06:20:39.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42332024-11-14T06:20:39.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42342024-11-14T06:20:39.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42352024-11-14T06:20:39.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42362024-11-14T06:20:39.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
42372024-11-14T06:20:39.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42382024-11-14T06:20:39.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42392024-11-14T06:20:39.411ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
42402024-11-14T06:20:39.411ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.675221ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
42412024-11-14T06:20:39.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42422024-11-14T06:20:39.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42432024-11-14T06:20:39.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.894063ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42442024-11-14T06:20:42.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 881dcb8a-d97e-4e7d-8a1c-eb2a2401dd24 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
42452024-11-14T06:20:42.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 881dcb8a-d97e-4e7d-8a1c-eb2a2401dd24 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
42462024-11-14T06:20:42.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 881dcb8a-d97e-4e7d-8a1c-eb2a2401dd24 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
42472024-11-14T06:20:42.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = e2196fe0-50fd-4d69-a9a0-527c10f6ddc9 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOGY4NjUxMS1kZDUxLTRmY2QtYmZkYy04ZTkyMjY0OTg4YjYifX0%3D
42482024-11-14T06:20:42.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = e2196fe0-50fd-4d69-a9a0-527c10f6ddc9 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOGY4NjUxMS1kZDUxLTRmY2QtYmZkYy04ZTkyMjY0OTg4YjYifX0%3D
42492024-11-14T06:20:42.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = e2196fe0-50fd-4d69-a9a0-527c10f6ddc9 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOGY4NjUxMS1kZDUxLTRmY2QtYmZkYy04ZTkyMjY0OTg4YjYifX0%3D
42502024-11-14T06:20:49.386ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
42512024-11-14T06:20:49.386ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42522024-11-14T06:20:49.386ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
42532024-11-14T06:20:49.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42542024-11-14T06:20:49.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42552024-11-14T06:20:49.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42562024-11-14T06:20:49.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42572024-11-14T06:20:49.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42582024-11-14T06:20:49.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42592024-11-14T06:20:49.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42602024-11-14T06:20:49.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42612024-11-14T06:20:49.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42622024-11-14T06:20:49.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42632024-11-14T06:20:49.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
42642024-11-14T06:20:49.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42652024-11-14T06:20:49.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42662024-11-14T06:20:49.409ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
42672024-11-14T06:20:49.409ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.199302ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
42682024-11-14T06:20:49.415ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42692024-11-14T06:20:49.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42702024-11-14T06:20:49.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.846568ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42712024-11-14T06:20:52.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1023 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 8a3004fc-87eb-49f4-93ba-d28037e10fd4 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
42722024-11-14T06:20:53.129ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41659
42732024-11-14T06:20:53.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41659 req_id = 78c292ac-f1db-4d24-b72b-fcb8a3363787 roles = RoleSet { roles: {} } uri = /metrics/producers
42742024-11-14T06:20:53.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41659 req_id = 78c292ac-f1db-4d24-b72b-fcb8a3363787 resource = Database result = Ok(()) uri = /metrics/producers
42752024-11-14T06:20:53.171ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6826e3df-ce47-4da7-be1a-7b4ea7b6cca4
42762024-11-14T06:20:53.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40839 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41659 req_id = 78c292ac-f1db-4d24-b72b-fcb8a3363787 response_code = 201 uri = /metrics/producers
42772024-11-14T06:20:59.207ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41300
42782024-11-14T06:20:59.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41300 req_id = 9a2e330f-8c06-4efb-9a30-975edde13f62 roles = RoleSet { roles: {} } uri = /metrics/producers
42792024-11-14T06:20:59.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41300 req_id = 9a2e330f-8c06-4efb-9a30-975edde13f62 resource = Database result = Ok(()) uri = /metrics/producers
42802024-11-14T06:20:59.219ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6cb81177-384c-420e-b49a-7c6450fab666
42812024-11-14T06:20:59.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11912 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41300 req_id = 9a2e330f-8c06-4efb-9a30-975edde13f62 response_code = 201 uri = /metrics/producers
42822024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
42832024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
42842024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42852024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42862024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
42872024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42882024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
42892024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
42902024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42912024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42922024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
42932024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42942024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
42952024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42962024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
42972024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42982024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
42992024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
43002024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43012024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43022024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
43032024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
43042024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43052024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
43062024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43072024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
43082024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
43092024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43102024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43112024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43122024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
43132024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43142024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
43152024-11-14T06:20:59.387ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43162024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43172024-11-14T06:20:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43182024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43192024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43202024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43212024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43222024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43232024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43242024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43252024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43262024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43272024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43282024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43292024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43302024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43312024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43322024-11-14T06:20:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43332024-11-14T06:20:59.390ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43342024-11-14T06:20:59.390ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1115, tv_nsec: 953497106 } })
43352024-11-14T06:20:59.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43362024-11-14T06:20:59.391ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
43372024-11-14T06:20:59.391ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.878913ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43382024-11-14T06:20:59.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43392024-11-14T06:20:59.392ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1115, tv_nsec: 954823671 } })
43402024-11-14T06:20:59.392ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
43412024-11-14T06:20:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43422024-11-14T06:20:59.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43432024-11-14T06:20:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43442024-11-14T06:20:59.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43452024-11-14T06:20:59.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43462024-11-14T06:20:59.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43472024-11-14T06:20:59.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43482024-11-14T06:20:59.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43492024-11-14T06:20:59.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43502024-11-14T06:20:59.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43512024-11-14T06:20:59.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43522024-11-14T06:20:59.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43532024-11-14T06:20:59.397ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43542024-11-14T06:20:59.397ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43552024-11-14T06:20:59.397ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43562024-11-14T06:20:59.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43572024-11-14T06:20:59.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43582024-11-14T06:20:59.401ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43592024-11-14T06:20:59.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43602024-11-14T06:20:59.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43612024-11-14T06:20:59.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43622024-11-14T06:20:59.401ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43632024-11-14T06:20:59.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43642024-11-14T06:20:59.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1115, tv_nsec: 968284962 } })
43652024-11-14T06:20:59.405ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
43662024-11-14T06:20:59.406ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43672024-11-14T06:20:59.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43682024-11-14T06:20:59.412ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43692024-11-14T06:20:59.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43702024-11-14T06:20:59.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.76062ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
43712024-11-14T06:20:59.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43722024-11-14T06:20:59.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43732024-11-14T06:20:59.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43742024-11-14T06:20:59.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43752024-11-14T06:20:59.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.796752ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43762024-11-14T06:20:59.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.772449ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
43772024-11-14T06:20:59.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43782024-11-14T06:20:59.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43792024-11-14T06:20:59.463ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43802024-11-14T06:20:59.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43812024-11-14T06:20:59.465ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43822024-11-14T06:20:59.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43832024-11-14T06:20:59.467ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43842024-11-14T06:20:59.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43852024-11-14T06:20:59.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43862024-11-14T06:20:59.468ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43872024-11-14T06:20:59.468ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43882024-11-14T06:20:59.468ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43892024-11-14T06:20:59.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43902024-11-14T06:20:59.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.716061ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
43912024-11-14T06:20:59.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
43922024-11-14T06:20:59.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43932024-11-14T06:20:59.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43942024-11-14T06:20:59.472ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43952024-11-14T06:20:59.473ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.302347ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43962024-11-14T06:20:59.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43972024-11-14T06:20:59.476ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43982024-11-14T06:20:59.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43992024-11-14T06:20:59.478ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44002024-11-14T06:20:59.478ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44012024-11-14T06:20:59.478ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 91.080866ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44022024-11-14T06:20:59.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44032024-11-14T06:20:59.480ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44042024-11-14T06:20:59.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44052024-11-14T06:20:59.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44062024-11-14T06:20:59.482ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44072024-11-14T06:20:59.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44082024-11-14T06:20:59.482ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
44092024-11-14T06:20:59.482ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44102024-11-14T06:20:59.483ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3ea9687-26d5-4ddf-907e-156f36ebda93", "content-length": "26", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
44112024-11-14T06:20:59.483ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44122024-11-14T06:20:59.483ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44132024-11-14T06:20:59.483ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44142024-11-14T06:20:59.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44152024-11-14T06:20:59.486ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44162024-11-14T06:20:59.488ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
44172024-11-14T06:20:59.488ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44182024-11-14T06:20:59.488ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "571fb711-5987-4f68-9eca-6c794444416e", "content-length": "26", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
44192024-11-14T06:20:59.488ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44202024-11-14T06:20:59.491ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44212024-11-14T06:20:59.492ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
44222024-11-14T06:20:59.492ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.117187ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
44232024-11-14T06:20:59.510ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44242024-11-14T06:20:59.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
44252024-11-14T06:20:59.513ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44262024-11-14T06:20:59.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44272024-11-14T06:20:59.514ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
44282024-11-14T06:20:59.514ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44292024-11-14T06:20:59.515ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fedeac57-f830-4a46-8cef-36f0238123d3", "content-length": "26", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
44302024-11-14T06:20:59.515ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44312024-11-14T06:20:59.517ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
44322024-11-14T06:20:59.524ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.149933ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44332024-11-14T06:20:59.527ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44342024-11-14T06:20:59.527ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44352024-11-14T06:20:59.527ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 139.862274ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44362024-11-14T06:20:59.546ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44372024-11-14T06:20:59.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44382024-11-14T06:20:59.593ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44392024-11-14T06:20:59.593ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 205.555976ms iteration = 4 status = {}
44402024-11-14T06:20:59.593ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f766600b-5c68-4ecb-be45-f4ca6ad376ef", "content-length": "1", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
44412024-11-14T06:20:59.596ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44422024-11-14T06:20:59.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44432024-11-14T06:20:59.597ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44442024-11-14T06:20:59.597ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44452024-11-14T06:20:59.598ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ef17ea6-f578-4538-b2c8-18b8d5a396d8", "content-length": "372", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
44462024-11-14T06:20:59.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44472024-11-14T06:20:59.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44482024-11-14T06:20:59.601ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 213.272259ms iteration = 4 status = 0
44492024-11-14T06:20:59.605ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 217.489718ms iteration = 4 status = null
44502024-11-14T06:20:59.616ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 229.237656ms iteration = 6 status = {"physical_disks_added":0}
44512024-11-14T06:20:59.666ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
44522024-11-14T06:20:59.666ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44532024-11-14T06:20:59.666ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e996ccd3-d4bb-45d3-ab7e-76a7c4c46af6", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
44542024-11-14T06:20:59.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44552024-11-14T06:20:59.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44562024-11-14T06:20:59.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44572024-11-14T06:20:59.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44582024-11-14T06:20:59.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44592024-11-14T06:20:59.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44602024-11-14T06:20:59.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44612024-11-14T06:20:59.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44622024-11-14T06:20:59.676ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
44632024-11-14T06:20:59.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44642024-11-14T06:20:59.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44652024-11-14T06:20:59.678ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44662024-11-14T06:20:59.678ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44672024-11-14T06:20:59.678ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "87282692-8d30-449e-9ce5-5d0476cca328", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
44682024-11-14T06:20:59.680ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 292.529575ms iteration = 5 status = {}
44692024-11-14T06:20:59.691ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44702024-11-14T06:20:59.693ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd92fb6f-5f5d-42c4-bfbd-6af01d3a418b", "content-length": "134", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
44712024-11-14T06:20:59.693ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44722024-11-14T06:20:59.693ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
44732024-11-14T06:20:59.693ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44742024-11-14T06:20:59.693ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44752024-11-14T06:20:59.693ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44762024-11-14T06:20:59.693ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44772024-11-14T06:20:59.693ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44782024-11-14T06:20:59.693ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44792024-11-14T06:20:59.693ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44802024-11-14T06:20:59.693ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44812024-11-14T06:20:59.694ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
44822024-11-14T06:20:59.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44832024-11-14T06:20:59.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44842024-11-14T06:20:59.696ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44852024-11-14T06:20:59.696ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3fe2b57-3ac1-42ca-b868-3598fe1e33d6", "content-length": "2", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
44862024-11-14T06:20:59.696ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44872024-11-14T06:20:59.696ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9be4a8d8-4cea-47ed-99a2-acec7ce5ff4e", "content-length": "52", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
44882024-11-14T06:20:59.696ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
44892024-11-14T06:20:59.696ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44902024-11-14T06:20:59.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44912024-11-14T06:20:59.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44922024-11-14T06:20:59.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44932024-11-14T06:20:59.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44942024-11-14T06:20:59.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44952024-11-14T06:20:59.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44962024-11-14T06:20:59.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44972024-11-14T06:20:59.766ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44982024-11-14T06:20:59.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44992024-11-14T06:20:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45002024-11-14T06:20:59.816ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b728e791-ad2f-445d-a20a-e8f35b180a4c", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
45012024-11-14T06:20:59.816ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
45022024-11-14T06:20:59.816ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45032024-11-14T06:20:59.821ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6239c1f9-46e4-45bf-bf64-0adfc3a0da3e", "content-length": "682", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
45042024-11-14T06:20:59.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45052024-11-14T06:20:59.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45062024-11-14T06:20:59.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45072024-11-14T06:20:59.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45082024-11-14T06:20:59.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45092024-11-14T06:20:59.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45102024-11-14T06:20:59.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45112024-11-14T06:20:59.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45122024-11-14T06:20:59.842ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 454.685543ms iteration = 4 status = {}
45132024-11-14T06:20:59.869ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45142024-11-14T06:20:59.871ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "97384cd1-7415-4dd1-a30e-8109c764fda7", "content-length": "691", "date": "Thu, 14 Nov 2024 06:20:59 GMT"} })
45152024-11-14T06:20:59.871ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
45162024-11-14T06:20:59.871ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
45172024-11-14T06:20:59.871ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
45182024-11-14T06:20:59.872ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 484.832564ms iteration = 4 status = {}
45192024-11-14T06:21:07.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1043 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 48432576-5284-461d-93ed-5c8fb0d39770 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
45202024-11-14T06:21:09.386ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
45212024-11-14T06:21:09.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45222024-11-14T06:21:09.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
45232024-11-14T06:21:09.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45242024-11-14T06:21:09.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45252024-11-14T06:21:09.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45262024-11-14T06:21:09.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272024-11-14T06:21:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45282024-11-14T06:21:09.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45292024-11-14T06:21:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45302024-11-14T06:21:09.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45312024-11-14T06:21:09.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45322024-11-14T06:21:09.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45332024-11-14T06:21:09.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
45342024-11-14T06:21:09.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45352024-11-14T06:21:09.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45362024-11-14T06:21:09.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45372024-11-14T06:21:09.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45382024-11-14T06:21:09.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.231825ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45392024-11-14T06:21:09.515ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
45402024-11-14T06:21:09.515ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 128.902029ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
45412024-11-14T06:21:12.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 5e99f481-3d7a-4f7e-9bcb-9bc70d646324 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
45422024-11-14T06:21:12.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 5e99f481-3d7a-4f7e-9bcb-9bc70d646324 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
45432024-11-14T06:21:12.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 5e99f481-3d7a-4f7e-9bcb-9bc70d646324 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
45442024-11-14T06:21:12.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 395e7f1b-2e42-46d0-821d-309a9890a52e roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOGY4NjUxMS1kZDUxLTRmY2QtYmZkYy04ZTkyMjY0OTg4YjYifX0%3D
45452024-11-14T06:21:12.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 395e7f1b-2e42-46d0-821d-309a9890a52e resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOGY4NjUxMS1kZDUxLTRmY2QtYmZkYy04ZTkyMjY0OTg4YjYifX0%3D
45462024-11-14T06:21:12.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 395e7f1b-2e42-46d0-821d-309a9890a52e response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOGY4NjUxMS1kZDUxLTRmY2QtYmZkYy04ZTkyMjY0OTg4YjYifX0%3D
45472024-11-14T06:21:19.386ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
45482024-11-14T06:21:19.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45492024-11-14T06:21:19.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
45502024-11-14T06:21:19.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45512024-11-14T06:21:19.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45522024-11-14T06:21:19.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45532024-11-14T06:21:19.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45542024-11-14T06:21:19.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45552024-11-14T06:21:19.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45562024-11-14T06:21:19.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45572024-11-14T06:21:19.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45582024-11-14T06:21:19.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45592024-11-14T06:21:19.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45602024-11-14T06:21:19.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
45612024-11-14T06:21:19.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45622024-11-14T06:21:19.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45632024-11-14T06:21:19.406ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
45642024-11-14T06:21:19.406ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.395781ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
45652024-11-14T06:21:19.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45662024-11-14T06:21:19.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45672024-11-14T06:21:19.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.468603ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45682024-11-14T06:21:22.602ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1125 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = a1025f82-4dbe-4b97-9cfe-550f6b86cce1 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
45692024-11-14T06:21:27.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 750b5298-f14d-4851-b349-cc31e3dfef86 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
45702024-11-14T06:21:27.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 750b5298-f14d-4851-b349-cc31e3dfef86 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
45712024-11-14T06:21:27.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 750b5298-f14d-4851-b349-cc31e3dfef86 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
45722024-11-14T06:21:27.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = bbec9c6b-aeed-4fa4-b38c-8b93ee3d15de roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOGY4NjUxMS1kZDUxLTRmY2QtYmZkYy04ZTkyMjY0OTg4YjYifX0%3D
45732024-11-14T06:21:27.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = bbec9c6b-aeed-4fa4-b38c-8b93ee3d15de resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOGY4NjUxMS1kZDUxLTRmY2QtYmZkYy04ZTkyMjY0OTg4YjYifX0%3D
45742024-11-14T06:21:27.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = bbec9c6b-aeed-4fa4-b38c-8b93ee3d15de response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiOGY4NjUxMS1kZDUxLTRmY2QtYmZkYy04ZTkyMjY0OTg4YjYifX0%3D
45752024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
45762024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45772024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
45782024-11-14T06:21:29.386ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
45792024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
45802024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
45812024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
45822024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45832024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45842024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
45852024-11-14T06:21:29.386ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
45862024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.97\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
45872024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
45882024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
45892024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
45902024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45912024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
45922024-11-14T06:21:29.386ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45932024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
45942024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45952024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45962024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
45972024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
45982024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45992024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
46002024-11-14T06:21:29.386ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:11:29.386875980 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
46012024-11-14T06:21:29.386ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
46022024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
46032024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46042024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
46052024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46062024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
46072024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
46082024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46092024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
46102024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
46112024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46122024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
46132024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
46142024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
46152024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
46162024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
46172024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
46182024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
46192024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46202024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
46212024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46222024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
46232024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46242024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
46252024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46262024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
46272024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46282024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
46292024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
46302024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
46312024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46322024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46332024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
46342024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
46352024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46362024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46372024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46382024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46392024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46402024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46412024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
46422024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46432024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
46442024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46452024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46462024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46472024-11-14T06:21:29.387ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1145, tv_nsec: 950343567 } })
46482024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46492024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46502024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46512024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46522024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
46532024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
46542024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46552024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46562024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46572024-11-14T06:21:29.387ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1145, tv_nsec: 950542861 } })
46582024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46592024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46602024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46612024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46622024-11-14T06:21:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46632024-11-14T06:21:29.388ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
46642024-11-14T06:21:29.388ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.313295ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
46652024-11-14T06:21:29.388ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
46662024-11-14T06:21:29.388ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.314505ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
46672024-11-14T06:21:29.390ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1145, tv_nsec: 952926006 } })
46682024-11-14T06:21:29.390ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46692024-11-14T06:21:29.390ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
46702024-11-14T06:21:29.391ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1145, tv_nsec: 953656069 } })
46712024-11-14T06:21:29.391ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
46722024-11-14T06:21:29.391ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.390082ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46732024-11-14T06:21:29.391ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.908661ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
46742024-11-14T06:21:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
46752024-11-14T06:21:29.392ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46762024-11-14T06:21:29.392ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:11:29.386875980 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
46772024-11-14T06:21:29.392ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.346659ms iteration = 3 status = {"expiration":"2024-11-14T06:11:29.386875980Z","pruned":[]}
46782024-11-14T06:21:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46792024-11-14T06:21:29.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46802024-11-14T06:21:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46812024-11-14T06:21:29.394ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46822024-11-14T06:21:29.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46832024-11-14T06:21:29.396ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46842024-11-14T06:21:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46852024-11-14T06:21:29.400ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46862024-11-14T06:21:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46872024-11-14T06:21:29.408ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46882024-11-14T06:21:29.408ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46892024-11-14T06:21:29.408ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46902024-11-14T06:21:29.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46912024-11-14T06:21:29.412ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46922024-11-14T06:21:29.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46932024-11-14T06:21:29.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46942024-11-14T06:21:29.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46952024-11-14T06:21:29.438ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46962024-11-14T06:21:29.438ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46972024-11-14T06:21:29.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46982024-11-14T06:21:29.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46992024-11-14T06:21:29.442ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47002024-11-14T06:21:29.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
47012024-11-14T06:21:29.447ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47022024-11-14T06:21:29.447ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47032024-11-14T06:21:29.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47042024-11-14T06:21:29.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.835323ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
47052024-11-14T06:21:29.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47062024-11-14T06:21:29.455ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47072024-11-14T06:21:29.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47082024-11-14T06:21:29.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 80.938957ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
47092024-11-14T06:21:29.473ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47102024-11-14T06:21:29.473ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47112024-11-14T06:21:29.474ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
47122024-11-14T06:21:29.475ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
47132024-11-14T06:21:29.475ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 88.009988ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
47142024-11-14T06:21:29.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47152024-11-14T06:21:29.476ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47162024-11-14T06:21:29.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47172024-11-14T06:21:29.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47182024-11-14T06:21:29.477ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47192024-11-14T06:21:29.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47202024-11-14T06:21:29.479ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47212024-11-14T06:21:29.479ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47222024-11-14T06:21:29.481ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47232024-11-14T06:21:29.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47242024-11-14T06:21:29.482ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47252024-11-14T06:21:29.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47262024-11-14T06:21:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47272024-11-14T06:21:29.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47282024-11-14T06:21:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47292024-11-14T06:21:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47302024-11-14T06:21:29.483ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47312024-11-14T06:21:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47322024-11-14T06:21:29.485ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47332024-11-14T06:21:29.485ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47342024-11-14T06:21:29.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47352024-11-14T06:21:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47362024-11-14T06:21:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47372024-11-14T06:21:29.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47382024-11-14T06:21:29.486ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47392024-11-14T06:21:29.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47402024-11-14T06:21:29.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47412024-11-14T06:21:29.489ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1146, tv_nsec: 51716364 } })
47422024-11-14T06:21:29.489ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47432024-11-14T06:21:29.489ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
47442024-11-14T06:21:29.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47452024-11-14T06:21:29.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47462024-11-14T06:21:29.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47472024-11-14T06:21:29.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47482024-11-14T06:21:29.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47492024-11-14T06:21:29.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47502024-11-14T06:21:29.492ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
47512024-11-14T06:21:29.492ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
47522024-11-14T06:21:29.492ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 105.652526ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
47532024-11-14T06:21:29.496ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
47542024-11-14T06:21:29.496ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
47552024-11-14T06:21:29.496ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
47562024-11-14T06:21:29.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47572024-11-14T06:21:29.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47582024-11-14T06:21:29.497ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47592024-11-14T06:21:29.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47602024-11-14T06:21:29.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47612024-11-14T06:21:29.499ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47622024-11-14T06:21:29.499ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.796581ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47632024-11-14T06:21:29.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47642024-11-14T06:21:29.500ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47652024-11-14T06:21:29.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47662024-11-14T06:21:29.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47672024-11-14T06:21:29.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47682024-11-14T06:21:29.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47692024-11-14T06:21:29.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47702024-11-14T06:21:29.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47712024-11-14T06:21:29.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47722024-11-14T06:21:29.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47732024-11-14T06:21:29.504ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 117.361775ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47742024-11-14T06:21:29.507ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47752024-11-14T06:21:29.507ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47762024-11-14T06:21:29.507ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.372391ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47772024-11-14T06:21:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47782024-11-14T06:21:29.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47792024-11-14T06:21:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47802024-11-14T06:21:29.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47812024-11-14T06:21:29.511ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47822024-11-14T06:21:29.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47832024-11-14T06:21:29.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
47842024-11-14T06:21:29.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47852024-11-14T06:21:29.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47862024-11-14T06:21:29.519ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
47872024-11-14T06:21:29.519ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
47882024-11-14T06:21:29.519ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47892024-11-14T06:21:29.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47902024-11-14T06:21:29.520ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.564357ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47912024-11-14T06:21:29.520ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47922024-11-14T06:21:29.521ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
47932024-11-14T06:21:29.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47942024-11-14T06:21:29.523ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47952024-11-14T06:21:29.523ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47962024-11-14T06:21:29.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47972024-11-14T06:21:29.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47982024-11-14T06:21:29.526ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47992024-11-14T06:21:29.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48002024-11-14T06:21:29.531ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
48012024-11-14T06:21:29.532ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48022024-11-14T06:21:29.532ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ae434d2-5416-486a-9c7a-7df6b5fe5acd", "content-length": "26", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} })
48032024-11-14T06:21:29.532ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48042024-11-14T06:21:29.534ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48052024-11-14T06:21:29.536ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
48062024-11-14T06:21:29.536ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
48072024-11-14T06:21:29.536ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
48082024-11-14T06:21:29.536ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 149.671166ms iteration = 4 status = {"generation":1}
48092024-11-14T06:21:29.541ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
48102024-11-14T06:21:29.541ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 154.753401ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
48112024-11-14T06:21:29.548ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
48122024-11-14T06:21:29.548ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
48132024-11-14T06:21:29.548ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
48142024-11-14T06:21:29.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48152024-11-14T06:21:29.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48162024-11-14T06:21:29.550ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 163.376381ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
48172024-11-14T06:21:29.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48182024-11-14T06:21:29.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
48192024-11-14T06:21:29.559ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
48202024-11-14T06:21:29.559ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48212024-11-14T06:21:29.559ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "19889b8d-1227-42ee-b61c-5908651c473c", "content-length": "26", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} })
48222024-11-14T06:21:29.559ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48232024-11-14T06:21:29.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48242024-11-14T06:21:29.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 173.991648ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48252024-11-14T06:21:29.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48262024-11-14T06:21:29.561ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48272024-11-14T06:21:29.563ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48282024-11-14T06:21:29.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48292024-11-14T06:21:29.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48302024-11-14T06:21:29.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
48312024-11-14T06:21:29.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48322024-11-14T06:21:29.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48332024-11-14T06:21:29.572ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 185.441991ms iteration = 5 status = 0
48342024-11-14T06:21:29.574ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
48352024-11-14T06:21:29.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48362024-11-14T06:21:29.605ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
48372024-11-14T06:21:29.605ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 218.567507ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
48382024-11-14T06:21:29.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48392024-11-14T06:21:29.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48402024-11-14T06:21:29.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48412024-11-14T06:21:29.612ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
48422024-11-14T06:21:29.612ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
48432024-11-14T06:21:29.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48442024-11-14T06:21:29.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48452024-11-14T06:21:29.664ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48462024-11-14T06:21:29.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48472024-11-14T06:21:29.680ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 293.37682ms iteration = 7 status = {"physical_disks_added":0}
48482024-11-14T06:21:29.707ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48492024-11-14T06:21:29.708ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ed39bda-fef0-465b-9d4a-268a2fc2d2e1", "content-length": "1", "date": "Thu, 14 Nov 2024 06:21:28 GMT"} })
48502024-11-14T06:21:29.710ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48512024-11-14T06:21:29.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48522024-11-14T06:21:29.715ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
48532024-11-14T06:21:29.715ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 328.431983ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
48542024-11-14T06:21:29.808ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
48552024-11-14T06:21:29.813ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
48562024-11-14T06:21:29.814ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6c2e393d-67d1-455f-8459-f4254822b5fd", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48572024-11-14T06:21:29.814ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48582024-11-14T06:21:29.815ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6c48595a-3992-4a9b-a174-54e7069c9135", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48592024-11-14T06:21:29.815ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48602024-11-14T06:21:29.817ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48612024-11-14T06:21:29.817ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 430.302589ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
48622024-11-14T06:21:29.820ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
48632024-11-14T06:21:29.820ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48642024-11-14T06:21:29.820ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cf3d67c-1db1-4f02-b364-de79c1aec94c", "content-length": "26", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} })
48652024-11-14T06:21:29.820ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48662024-11-14T06:21:29.822ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
48672024-11-14T06:21:29.849ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 462.462497ms iteration = 5 status = {}
48682024-11-14T06:21:29.854ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48692024-11-14T06:21:29.854ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48702024-11-14T06:21:29.854ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e02f8af2-3e0e-4778-bfac-1d5017231c12", "content-length": "372", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} })
48712024-11-14T06:21:29.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48722024-11-14T06:21:29.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48732024-11-14T06:21:29.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48742024-11-14T06:21:29.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48752024-11-14T06:21:29.858ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48762024-11-14T06:21:29.858ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48772024-11-14T06:21:29.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48782024-11-14T06:21:29.859ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 472.951833ms iteration = 5 status = null
48792024-11-14T06:21:29.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48802024-11-14T06:21:29.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48812024-11-14T06:21:29.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48822024-11-14T06:21:29.863ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
48832024-11-14T06:21:29.863ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
48842024-11-14T06:21:29.863ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
48852024-11-14T06:21:29.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 476.629892ms iteration = 4 status = {"generation":2}
48862024-11-14T06:21:29.889ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
48872024-11-14T06:21:29.890ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "334631b3-26ae-47da-ba9f-196cf4c7af9c", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
48882024-11-14T06:21:29.890ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
48892024-11-14T06:21:29.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48902024-11-14T06:21:29.891ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0ec8f450-ded3-4a62-b0b2-0c5554ab23c6", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
48912024-11-14T06:21:29.891ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
48922024-11-14T06:21:29.893ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48932024-11-14T06:21:29.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48942024-11-14T06:21:29.893ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "43e1e2cf-e68b-473e-8edd-4febe6f1fb60", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
48952024-11-14T06:21:29.893ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
48962024-11-14T06:21:29.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48972024-11-14T06:21:29.895ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
48982024-11-14T06:21:29.895ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 507.998825ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
48992024-11-14T06:21:29.905ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
49002024-11-14T06:21:29.905ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49012024-11-14T06:21:29.905ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cd3b98db-6c40-41b7-ac5b-bad8f581f455", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} })
49022024-11-14T06:21:29.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49032024-11-14T06:21:29.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49042024-11-14T06:21:29.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49052024-11-14T06:21:29.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49062024-11-14T06:21:29.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49072024-11-14T06:21:29.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49082024-11-14T06:21:29.924ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49092024-11-14T06:21:29.924ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49102024-11-14T06:21:29.924ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "48554530-c0c1-446e-b4cc-24530a53ad61", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} })
49112024-11-14T06:21:29.926ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 539.213187ms iteration = 6 status = {}
49122024-11-14T06:21:29.961ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49132024-11-14T06:21:29.961ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f12a4941-601a-4b94-b6d4-f8fbca59f3ff", "content-length": "691", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} })
49142024-11-14T06:21:29.961ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
49152024-11-14T06:21:29.961ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
49162024-11-14T06:21:29.961ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
49172024-11-14T06:21:29.962ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 576.079862ms iteration = 5 status = {}
49182024-11-14T06:21:30.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49192024-11-14T06:21:30.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49202024-11-14T06:21:30.001ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
49212024-11-14T06:21:30.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49222024-11-14T06:21:30.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49232024-11-14T06:21:30.013ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
49242024-11-14T06:21:30.013ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7abf1e8e-8514-49d6-b693-2031fd4bcd90", "content-length": "134", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} })
49252024-11-14T06:21:30.013ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
49262024-11-14T06:21:30.014ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
49272024-11-14T06:21:30.014ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49282024-11-14T06:21:30.014ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49292024-11-14T06:21:30.014ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49302024-11-14T06:21:30.014ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49312024-11-14T06:21:30.014ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49322024-11-14T06:21:30.014ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49332024-11-14T06:21:30.014ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49342024-11-14T06:21:30.014ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49352024-11-14T06:21:30.014ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
49362024-11-14T06:21:30.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49372024-11-14T06:21:30.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49382024-11-14T06:21:30.016ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49392024-11-14T06:21:30.017ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "59878d91-0b04-458b-9734-9c671e7f302d", "content-length": "2", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} })
49402024-11-14T06:21:30.017ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49412024-11-14T06:21:30.017ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "83058a57-18ff-447d-ad88-4fa7b5b2eca6", "content-length": "52", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} })
49422024-11-14T06:21:30.017ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
49432024-11-14T06:21:30.017ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49442024-11-14T06:21:30.169ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7e89f7f2-658e-4735-9fe1-86dc48a5c029", "date": "Thu, 14 Nov 2024 06:21:30 GMT"} })
49452024-11-14T06:21:30.169ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
49462024-11-14T06:21:30.169ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49472024-11-14T06:21:30.172ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf539972-0ae8-4498-b10e-ec6b2bf47327", "content-length": "682", "date": "Thu, 14 Nov 2024 06:21:29 GMT"} })
49482024-11-14T06:21:30.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49492024-11-14T06:21:30.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49502024-11-14T06:21:30.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49512024-11-14T06:21:30.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49522024-11-14T06:21:30.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49532024-11-14T06:21:30.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49542024-11-14T06:21:30.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49552024-11-14T06:21:30.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49562024-11-14T06:21:30.191ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 804.518985ms iteration = 5 status = {}
49572024-11-14T06:21:34.573ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:45426
49582024-11-14T06:21:34.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45426 req_id = 79b1ff61-d4be-4ade-ad07-c7ba0f7748c7 roles = RoleSet { roles: {} } uri = /metrics/producers
49592024-11-14T06:21:34.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45426 req_id = 79b1ff61-d4be-4ade-ad07-c7ba0f7748c7 resource = Database result = Ok(()) uri = /metrics/producers
49602024-11-14T06:21:34.616ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = f9c06870-e51f-43ae-842e-1fb78f798f41
49612024-11-14T06:21:34.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42490 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45426 req_id = 79b1ff61-d4be-4ade-ad07-c7ba0f7748c7 response_code = 201 uri = /metrics/producers
49622024-11-14T06:21:37.602ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1007 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = fa5d4e5a-aaa5-4331-9755-40279ca0b353 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
49632024-11-14T06:21:39.386ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
49642024-11-14T06:21:39.386ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
49652024-11-14T06:21:39.386ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49662024-11-14T06:21:39.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49672024-11-14T06:21:39.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49682024-11-14T06:21:39.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49692024-11-14T06:21:39.388ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49702024-11-14T06:21:39.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49712024-11-14T06:21:39.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49722024-11-14T06:21:39.390ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.822781ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49732024-11-14T06:21:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49742024-11-14T06:21:39.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49752024-11-14T06:21:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49762024-11-14T06:21:39.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49772024-11-14T06:21:39.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49782024-11-14T06:21:39.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49792024-11-14T06:21:39.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
49802024-11-14T06:21:39.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49812024-11-14T06:21:39.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49822024-11-14T06:21:39.405ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
49832024-11-14T06:21:39.405ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.092975ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
49842024-11-14T06:21:42.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = ddaac8ee-437e-4add-b92f-c729db9d2df1 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
49852024-11-14T06:21:42.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = ddaac8ee-437e-4add-b92f-c729db9d2df1 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
49862024-11-14T06:21:42.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = ddaac8ee-437e-4add-b92f-c729db9d2df1 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
49872024-11-14T06:21:42.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 90b94ba6-beb6-48a8-b616-efeb22cbf3b8 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
49882024-11-14T06:21:42.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 90b94ba6-beb6-48a8-b616-efeb22cbf3b8 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
49892024-11-14T06:21:42.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 90b94ba6-beb6-48a8-b616-efeb22cbf3b8 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
49902024-11-14T06:21:49.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
49912024-11-14T06:21:49.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49922024-11-14T06:21:49.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
49932024-11-14T06:21:49.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49942024-11-14T06:21:49.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49952024-11-14T06:21:49.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49962024-11-14T06:21:49.389ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49972024-11-14T06:21:49.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49982024-11-14T06:21:49.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49992024-11-14T06:21:49.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.044065ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50002024-11-14T06:21:49.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50012024-11-14T06:21:49.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50022024-11-14T06:21:49.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50032024-11-14T06:21:49.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50042024-11-14T06:21:49.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50052024-11-14T06:21:49.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50062024-11-14T06:21:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
50072024-11-14T06:21:49.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50082024-11-14T06:21:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50092024-11-14T06:21:49.405ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
50102024-11-14T06:21:49.405ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.109487ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
50112024-11-14T06:21:52.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1433 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 374df22b-0423-4753-bda8-670f41c49e5e response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
50122024-11-14T06:21:57.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 93d04dfa-ea7d-49a8-a228-68eb768812eb roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
50132024-11-14T06:21:57.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 93d04dfa-ea7d-49a8-a228-68eb768812eb resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
50142024-11-14T06:21:57.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 93d04dfa-ea7d-49a8-a228-68eb768812eb response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
50152024-11-14T06:21:57.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 3cbb1082-7a50-47f8-b2bd-d0504bad10ca roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
50162024-11-14T06:21:57.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 3cbb1082-7a50-47f8-b2bd-d0504bad10ca resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
50172024-11-14T06:21:57.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 3cbb1082-7a50-47f8-b2bd-d0504bad10ca response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
50182024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
50192024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
50202024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50212024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50222024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
50232024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
50242024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50252024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50262024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
50272024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50282024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50292024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
50302024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
50312024-11-14T06:21:59.387ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50322024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50332024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50342024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
50352024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50362024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
50372024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
50382024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50392024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
50402024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50412024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
50422024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
50432024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50442024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50452024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
50462024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50472024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
50482024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
50492024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50502024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50512024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
50522024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50532024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50542024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50552024-11-14T06:21:59.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50562024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50572024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50582024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50592024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50602024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50612024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50622024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50632024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50642024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50652024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50662024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50672024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50682024-11-14T06:21:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50692024-11-14T06:21:59.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50702024-11-14T06:21:59.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50712024-11-14T06:21:59.390ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50722024-11-14T06:21:59.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50732024-11-14T06:21:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50742024-11-14T06:21:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50752024-11-14T06:21:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50762024-11-14T06:21:59.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50772024-11-14T06:21:59.392ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.747729ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50782024-11-14T06:21:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50792024-11-14T06:21:59.392ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50802024-11-14T06:21:59.392ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50812024-11-14T06:21:59.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50822024-11-14T06:21:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50832024-11-14T06:21:59.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50842024-11-14T06:21:59.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50852024-11-14T06:21:59.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50862024-11-14T06:21:59.394ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1175, tv_nsec: 956686005 } })
50872024-11-14T06:21:59.394ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
50882024-11-14T06:21:59.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50892024-11-14T06:21:59.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50902024-11-14T06:21:59.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.437887ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
50912024-11-14T06:21:59.395ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50922024-11-14T06:21:59.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50932024-11-14T06:21:59.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50942024-11-14T06:21:59.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50952024-11-14T06:21:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50962024-11-14T06:21:59.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50972024-11-14T06:21:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50982024-11-14T06:21:59.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50992024-11-14T06:21:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51002024-11-14T06:21:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51012024-11-14T06:21:59.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.079802ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
51022024-11-14T06:21:59.401ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1175, tv_nsec: 964624253 } })
51032024-11-14T06:21:59.402ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
51042024-11-14T06:21:59.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51052024-11-14T06:21:59.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51062024-11-14T06:21:59.404ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51072024-11-14T06:21:59.404ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1175, tv_nsec: 967590098 } })
51082024-11-14T06:21:59.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51092024-11-14T06:21:59.405ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51102024-11-14T06:21:59.405ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51112024-11-14T06:21:59.405ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51122024-11-14T06:21:59.405ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
51132024-11-14T06:21:59.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51142024-11-14T06:21:59.408ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51152024-11-14T06:21:59.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51162024-11-14T06:21:59.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51172024-11-14T06:21:59.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51182024-11-14T06:21:59.411ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51192024-11-14T06:21:59.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51202024-11-14T06:21:59.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51212024-11-14T06:21:59.414ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51222024-11-14T06:21:59.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51232024-11-14T06:21:59.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51242024-11-14T06:21:59.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51252024-11-14T06:21:59.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51262024-11-14T06:21:59.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51272024-11-14T06:21:59.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51282024-11-14T06:21:59.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51292024-11-14T06:21:59.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
51302024-11-14T06:21:59.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51312024-11-14T06:21:59.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51322024-11-14T06:21:59.439ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 51.919836ms iteration = 8 status = {"physical_disks_added":0}
51332024-11-14T06:21:59.443ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
51342024-11-14T06:21:59.443ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.291809ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
51352024-11-14T06:21:59.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51362024-11-14T06:21:59.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51372024-11-14T06:21:59.455ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51382024-11-14T06:21:59.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51392024-11-14T06:21:59.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.249075ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51402024-11-14T06:21:59.466ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51412024-11-14T06:21:59.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51422024-11-14T06:21:59.467ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51432024-11-14T06:21:59.467ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51442024-11-14T06:21:59.467ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 80.57764ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51452024-11-14T06:21:59.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 81.640939ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
51462024-11-14T06:21:59.470ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
51472024-11-14T06:21:59.470ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51482024-11-14T06:21:59.470ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f868410-c55f-472f-bdca-7b022003cec0", "content-length": "26", "date": "Thu, 14 Nov 2024 06:21:59 GMT"} })
51492024-11-14T06:21:59.470ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51502024-11-14T06:21:59.471ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51512024-11-14T06:21:59.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51522024-11-14T06:21:59.473ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51532024-11-14T06:21:59.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51542024-11-14T06:21:59.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51552024-11-14T06:21:59.477ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51562024-11-14T06:21:59.477ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.538085ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51572024-11-14T06:21:59.483ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
51582024-11-14T06:21:59.483ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51592024-11-14T06:21:59.483ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b9d423e-213c-4a1f-adac-d6462b2df6ef", "content-length": "26", "date": "Thu, 14 Nov 2024 06:21:59 GMT"} })
51602024-11-14T06:21:59.484ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51612024-11-14T06:21:59.485ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51622024-11-14T06:21:59.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.503422ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51632024-11-14T06:21:59.504ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 117.178671ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51642024-11-14T06:21:59.510ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
51652024-11-14T06:21:59.510ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51662024-11-14T06:21:59.510ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bf793b7-d3f3-4139-9a6a-70c90d8f6756", "content-length": "26", "date": "Thu, 14 Nov 2024 06:21:59 GMT"} })
51672024-11-14T06:21:59.510ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51682024-11-14T06:21:59.512ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
51692024-11-14T06:21:59.514ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51702024-11-14T06:21:59.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
51712024-11-14T06:21:59.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51722024-11-14T06:21:59.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51732024-11-14T06:21:59.518ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 131.682771ms iteration = 6 status = 0
51742024-11-14T06:21:59.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51752024-11-14T06:21:59.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51762024-11-14T06:21:59.585ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51772024-11-14T06:21:59.585ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4204c9f7-f507-40d5-96fa-8ee5867bebde", "content-length": "1", "date": "Thu, 14 Nov 2024 06:21:58 GMT"} })
51782024-11-14T06:21:59.587ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51792024-11-14T06:21:59.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51802024-11-14T06:21:59.589ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.495279ms iteration = 6 status = null
51812024-11-14T06:21:59.598ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 211.094989ms iteration = 6 status = {}
51822024-11-14T06:21:59.620ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51832024-11-14T06:21:59.620ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51842024-11-14T06:21:59.621ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6aa16406-31cc-4ed6-935f-d88010f75a12", "content-length": "372", "date": "Thu, 14 Nov 2024 06:21:59 GMT"} })
51852024-11-14T06:21:59.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51862024-11-14T06:21:59.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51872024-11-14T06:21:59.639ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
51882024-11-14T06:21:59.639ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51892024-11-14T06:21:59.640ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7add3e36-2c3f-44b4-89ac-30450ab893c5", "date": "Thu, 14 Nov 2024 06:21:59 GMT"} })
51902024-11-14T06:21:59.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51912024-11-14T06:21:59.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51922024-11-14T06:21:59.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51932024-11-14T06:21:59.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51942024-11-14T06:21:59.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51952024-11-14T06:21:59.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51962024-11-14T06:21:59.649ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51972024-11-14T06:21:59.649ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51982024-11-14T06:21:59.649ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3dd5b317-3a44-41f7-9ee3-3465efbcb285", "date": "Thu, 14 Nov 2024 06:21:59 GMT"} })
51992024-11-14T06:21:59.651ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 264.35872ms iteration = 7 status = {}
52002024-11-14T06:21:59.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52012024-11-14T06:21:59.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52022024-11-14T06:21:59.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52032024-11-14T06:21:59.675ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52042024-11-14T06:21:59.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52052024-11-14T06:21:59.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52062024-11-14T06:21:59.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52072024-11-14T06:21:59.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52082024-11-14T06:21:59.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52092024-11-14T06:21:59.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52102024-11-14T06:21:59.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52112024-11-14T06:21:59.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52122024-11-14T06:21:59.704ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
52132024-11-14T06:21:59.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52142024-11-14T06:21:59.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52152024-11-14T06:21:59.716ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52162024-11-14T06:21:59.717ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d2d2d8e-a07f-4488-9b12-4e884ef06046", "content-length": "134", "date": "Thu, 14 Nov 2024 06:21:58 GMT"} })
52172024-11-14T06:21:59.717ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
52182024-11-14T06:21:59.717ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
52192024-11-14T06:21:59.717ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52202024-11-14T06:21:59.717ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52212024-11-14T06:21:59.717ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52222024-11-14T06:21:59.717ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52232024-11-14T06:21:59.717ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52242024-11-14T06:21:59.717ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52252024-11-14T06:21:59.717ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52262024-11-14T06:21:59.717ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52272024-11-14T06:21:59.718ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
52282024-11-14T06:21:59.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52292024-11-14T06:21:59.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52302024-11-14T06:21:59.719ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52312024-11-14T06:21:59.720ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a161f5e7-2b59-4a11-a650-83882099ca56", "content-length": "2", "date": "Thu, 14 Nov 2024 06:21:58 GMT"} })
52322024-11-14T06:21:59.720ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52332024-11-14T06:21:59.720ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1685bdc-6d7a-4dc7-9745-4bbaacdf4ec2", "content-length": "52", "date": "Thu, 14 Nov 2024 06:21:58 GMT"} })
52342024-11-14T06:21:59.720ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
52352024-11-14T06:21:59.720ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52362024-11-14T06:21:59.722ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52372024-11-14T06:21:59.826ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2caa739e-1995-4c4b-98ec-d9259f8a97d5", "date": "Thu, 14 Nov 2024 06:21:59 GMT"} })
52382024-11-14T06:21:59.826ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
52392024-11-14T06:21:59.826ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52402024-11-14T06:21:59.826ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a459cfc-40f5-42f6-b3be-2cd8fcfbf095", "content-length": "682", "date": "Thu, 14 Nov 2024 06:21:59 GMT"} })
52412024-11-14T06:21:59.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52422024-11-14T06:21:59.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52432024-11-14T06:21:59.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52442024-11-14T06:21:59.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52452024-11-14T06:21:59.832ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "326e6bf8-a8bd-4f1e-a5f2-782094f90f02", "content-length": "691", "date": "Thu, 14 Nov 2024 06:21:59 GMT"} })
52462024-11-14T06:21:59.832ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
52472024-11-14T06:21:59.832ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
52482024-11-14T06:21:59.832ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
52492024-11-14T06:21:59.834ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 446.853758ms iteration = 6 status = {}
52502024-11-14T06:21:59.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52512024-11-14T06:21:59.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52522024-11-14T06:21:59.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52532024-11-14T06:21:59.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52542024-11-14T06:21:59.843ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 456.796552ms iteration = 6 status = {}
52552024-11-14T06:22:03.339ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
52562024-11-14T06:22:03.339ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
52572024-11-14T06:22:03.368ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
52582024-11-14T06:22:03.368ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:59716
52592024-11-14T06:22:03.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59716 req_id = 2929a28e-10ed-4c1b-8518-2bc7027d3e2a roles = RoleSet { roles: {} } uri = /metrics/producers
52602024-11-14T06:22:03.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59716 req_id = 2929a28e-10ed-4c1b-8518-2bc7027d3e2a resource = Database result = Ok(()) uri = /metrics/producers
52612024-11-14T06:22:03.413ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
52622024-11-14T06:22:03.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44957 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:59716 req_id = 2929a28e-10ed-4c1b-8518-2bc7027d3e2a response_code = 201 uri = /metrics/producers
52632024-11-14T06:22:03.413ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2929a28e-10ed-4c1b-8518-2bc7027d3e2a", "content-length": "41", "date": "Thu, 14 Nov 2024 06:22:03 GMT"} })
52642024-11-14T06:22:03.415ZDEBGnexus (producer-registration-task): registered with nexus successfully
52652024-11-14T06:22:03.415ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
52662024-11-14T06:22:07.601ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1262 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = f13363d3-c2b3-40f0-81ce-99c921d2fd97 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
52672024-11-14T06:22:09.387ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
52682024-11-14T06:22:09.387ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
52692024-11-14T06:22:09.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52702024-11-14T06:22:09.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52712024-11-14T06:22:09.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52722024-11-14T06:22:09.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52732024-11-14T06:22:09.389ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52742024-11-14T06:22:09.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52752024-11-14T06:22:09.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52762024-11-14T06:22:09.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.978765ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52772024-11-14T06:22:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52782024-11-14T06:22:09.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52792024-11-14T06:22:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52802024-11-14T06:22:09.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52812024-11-14T06:22:09.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52822024-11-14T06:22:09.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52832024-11-14T06:22:09.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
52842024-11-14T06:22:09.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52852024-11-14T06:22:09.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52862024-11-14T06:22:09.406ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
52872024-11-14T06:22:09.406ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.663237ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
52882024-11-14T06:22:14.816ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:54353
52892024-11-14T06:22:14.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54353 req_id = 27ea4f3d-37a3-449d-9a7f-cdf7e9e942fc roles = RoleSet { roles: {} } uri = /metrics/producers
52902024-11-14T06:22:14.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54353 req_id = 27ea4f3d-37a3-449d-9a7f-cdf7e9e942fc resource = Database result = Ok(()) uri = /metrics/producers
52912024-11-14T06:22:14.826ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
52922024-11-14T06:22:14.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9539 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54353 req_id = 27ea4f3d-37a3-449d-9a7f-cdf7e9e942fc response_code = 201 uri = /metrics/producers
52932024-11-14T06:22:19.386ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
52942024-11-14T06:22:19.386ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
52952024-11-14T06:22:19.386ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52962024-11-14T06:22:19.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52972024-11-14T06:22:19.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52982024-11-14T06:22:19.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52992024-11-14T06:22:19.388ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53002024-11-14T06:22:19.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53012024-11-14T06:22:19.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53022024-11-14T06:22:19.390ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.7787ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53032024-11-14T06:22:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53042024-11-14T06:22:19.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53052024-11-14T06:22:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53062024-11-14T06:22:19.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53072024-11-14T06:22:19.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53082024-11-14T06:22:19.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53092024-11-14T06:22:19.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
53102024-11-14T06:22:19.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53112024-11-14T06:22:19.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53122024-11-14T06:22:19.407ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
53132024-11-14T06:22:19.407ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.172656ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
53142024-11-14T06:22:21.316ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34817
53152024-11-14T06:22:21.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34817 req_id = 0e2baa3c-f821-4fb0-bea1-208102997dab roles = RoleSet { roles: {} } uri = /metrics/producers
53162024-11-14T06:22:21.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34817 req_id = 0e2baa3c-f821-4fb0-bea1-208102997dab resource = Database result = Ok(()) uri = /metrics/producers
53172024-11-14T06:22:21.355ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 914339bb-5810-4f30-ae08-365f08250a83
53182024-11-14T06:22:21.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38943 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34817 req_id = 0e2baa3c-f821-4fb0-bea1-208102997dab response_code = 201 uri = /metrics/producers
53192024-11-14T06:22:22.602ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1247 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 84d8752b-4d62-4a0f-9aa5-8a897f49cd28 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
53202024-11-14T06:22:27.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 9f3c8d7f-8a39-455a-ba9d-44c03030e6a4 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
53212024-11-14T06:22:27.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 9f3c8d7f-8a39-455a-ba9d-44c03030e6a4 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
53222024-11-14T06:22:27.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 9f3c8d7f-8a39-455a-ba9d-44c03030e6a4 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
53232024-11-14T06:22:27.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 045fa995-fce3-46cf-af53-9b77fa1ec4be roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
53242024-11-14T06:22:27.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 045fa995-fce3-46cf-af53-9b77fa1ec4be resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
53252024-11-14T06:22:27.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 045fa995-fce3-46cf-af53-9b77fa1ec4be response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
53262024-11-14T06:22:29.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
53272024-11-14T06:22:29.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
53282024-11-14T06:22:29.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53292024-11-14T06:22:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
53302024-11-14T06:22:29.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53312024-11-14T06:22:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
53322024-11-14T06:22:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53332024-11-14T06:22:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
53342024-11-14T06:22:29.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53352024-11-14T06:22:29.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53362024-11-14T06:22:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
53372024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
53382024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
53392024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53402024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53412024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
53422024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
53432024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53442024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
53452024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
53462024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53472024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53482024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
53492024-11-14T06:22:29.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53502024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53512024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
53522024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
53532024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53542024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53552024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
53562024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53572024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
53582024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53592024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
53602024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
53612024-11-14T06:22:29.392ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53622024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53632024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
53642024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53652024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53662024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
53672024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
53682024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53692024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53702024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
53712024-11-14T06:22:29.392ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
53722024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.631\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
53732024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
53742024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
53752024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
53762024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53772024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
53782024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
53792024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53802024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
53812024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53822024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53832024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
53842024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53852024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
53862024-11-14T06:22:29.392ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:12:29.392307919 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
53872024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
53882024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
53892024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53902024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53912024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53922024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53932024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53942024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53952024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53962024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53972024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53982024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53992024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54002024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54012024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54022024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54032024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54042024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54052024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
54062024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54072024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54082024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54092024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54102024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54112024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54122024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54132024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54142024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54152024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
54162024-11-14T06:22:29.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1205, tv_nsec: 950601542 } })
54172024-11-14T06:22:29.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1205, tv_nsec: 950645983 } })
54182024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54192024-11-14T06:22:29.392ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54202024-11-14T06:22:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54212024-11-14T06:22:29.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54222024-11-14T06:22:29.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
54232024-11-14T06:22:29.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.300074ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
54242024-11-14T06:22:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54252024-11-14T06:22:29.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54262024-11-14T06:22:29.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
54272024-11-14T06:22:29.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.102381ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
54282024-11-14T06:22:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54292024-11-14T06:22:29.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54302024-11-14T06:22:29.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54312024-11-14T06:22:29.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54322024-11-14T06:22:29.395ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54332024-11-14T06:22:29.396ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.105377ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54342024-11-14T06:22:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54352024-11-14T06:22:29.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54362024-11-14T06:22:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54372024-11-14T06:22:29.397ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54382024-11-14T06:22:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54392024-11-14T06:22:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54402024-11-14T06:22:29.399ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
54412024-11-14T06:22:29.399ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
54422024-11-14T06:22:29.399ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 7.222495ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
54432024-11-14T06:22:29.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54442024-11-14T06:22:29.400ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54452024-11-14T06:22:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54462024-11-14T06:22:29.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54472024-11-14T06:22:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54482024-11-14T06:22:29.401ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54492024-11-14T06:22:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54502024-11-14T06:22:29.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54512024-11-14T06:22:29.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54522024-11-14T06:22:29.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54532024-11-14T06:22:29.403ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54542024-11-14T06:22:29.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54552024-11-14T06:22:29.404ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54562024-11-14T06:22:29.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54572024-11-14T06:22:29.405ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.316088ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
54582024-11-14T06:22:29.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1205, tv_nsec: 963779088 } })
54592024-11-14T06:22:29.406ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.920379ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
54602024-11-14T06:22:29.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
54612024-11-14T06:22:29.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54622024-11-14T06:22:29.407ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632024-11-14T06:22:29.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54642024-11-14T06:22:29.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54652024-11-14T06:22:29.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54662024-11-14T06:22:29.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54672024-11-14T06:22:29.409ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54682024-11-14T06:22:29.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54692024-11-14T06:22:29.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54702024-11-14T06:22:29.415ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1205, tv_nsec: 972883077 } })
54712024-11-14T06:22:29.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54722024-11-14T06:22:29.415ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
54732024-11-14T06:22:29.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54742024-11-14T06:22:29.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54752024-11-14T06:22:29.422ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:12:29.392307919 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
54762024-11-14T06:22:29.422ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 29.722983ms iteration = 4 status = {"expiration":"2024-11-14T06:12:29.392307919Z","pruned":[]}
54772024-11-14T06:22:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54782024-11-14T06:22:29.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54792024-11-14T06:22:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54802024-11-14T06:22:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54812024-11-14T06:22:29.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54822024-11-14T06:22:29.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54832024-11-14T06:22:29.424ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54842024-11-14T06:22:29.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54852024-11-14T06:22:29.425ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54862024-11-14T06:22:29.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54872024-11-14T06:22:29.427ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54882024-11-14T06:22:29.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54892024-11-14T06:22:29.429ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54902024-11-14T06:22:29.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54912024-11-14T06:22:29.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54922024-11-14T06:22:29.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.527926ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54932024-11-14T06:22:29.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54942024-11-14T06:22:29.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54952024-11-14T06:22:29.432ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54962024-11-14T06:22:29.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54972024-11-14T06:22:29.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54982024-11-14T06:22:29.436ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54992024-11-14T06:22:29.437ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
55002024-11-14T06:22:29.437ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55012024-11-14T06:22:29.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55022024-11-14T06:22:29.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55032024-11-14T06:22:29.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55042024-11-14T06:22:29.439ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55052024-11-14T06:22:29.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55062024-11-14T06:22:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55072024-11-14T06:22:29.440ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55082024-11-14T06:22:29.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55092024-11-14T06:22:29.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1205, tv_nsec: 998694387 } })
55102024-11-14T06:22:29.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
55112024-11-14T06:22:29.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55122024-11-14T06:22:29.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55132024-11-14T06:22:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55142024-11-14T06:22:29.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55152024-11-14T06:22:29.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55162024-11-14T06:22:29.447ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55172024-11-14T06:22:29.447ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55182024-11-14T06:22:29.447ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55192024-11-14T06:22:29.447ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55202024-11-14T06:22:29.448ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55212024-11-14T06:22:29.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55222024-11-14T06:22:29.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55232024-11-14T06:22:29.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55242024-11-14T06:22:29.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55252024-11-14T06:22:29.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55262024-11-14T06:22:29.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.867984ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
55272024-11-14T06:22:29.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
55282024-11-14T06:22:29.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55292024-11-14T06:22:29.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55302024-11-14T06:22:29.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55312024-11-14T06:22:29.456ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55322024-11-14T06:22:29.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55332024-11-14T06:22:29.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55342024-11-14T06:22:29.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55352024-11-14T06:22:29.466ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55362024-11-14T06:22:29.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55372024-11-14T06:22:29.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55382024-11-14T06:22:29.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55392024-11-14T06:22:29.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
55402024-11-14T06:22:29.470ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55412024-11-14T06:22:29.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55422024-11-14T06:22:29.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55432024-11-14T06:22:29.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55442024-11-14T06:22:29.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55452024-11-14T06:22:29.477ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55462024-11-14T06:22:29.478ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55472024-11-14T06:22:29.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55482024-11-14T06:22:29.478ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55492024-11-14T06:22:29.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55502024-11-14T06:22:29.480ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55512024-11-14T06:22:29.480ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55522024-11-14T06:22:29.480ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55532024-11-14T06:22:29.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
55542024-11-14T06:22:29.480ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
55552024-11-14T06:22:29.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55562024-11-14T06:22:29.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
55572024-11-14T06:22:29.483ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55582024-11-14T06:22:29.484ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55592024-11-14T06:22:29.484ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55602024-11-14T06:22:29.484ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55612024-11-14T06:22:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55622024-11-14T06:22:29.485ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55632024-11-14T06:22:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55642024-11-14T06:22:29.485ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55652024-11-14T06:22:29.485ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55662024-11-14T06:22:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55672024-11-14T06:22:29.494ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
55682024-11-14T06:22:29.494ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.955616ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
55692024-11-14T06:22:29.512ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55702024-11-14T06:22:29.512ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 120.600085ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55712024-11-14T06:22:29.512ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55722024-11-14T06:22:29.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55732024-11-14T06:22:29.514ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55742024-11-14T06:22:29.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55752024-11-14T06:22:29.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55762024-11-14T06:22:29.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55772024-11-14T06:22:29.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55782024-11-14T06:22:29.517ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55792024-11-14T06:22:29.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55802024-11-14T06:22:29.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55812024-11-14T06:22:29.519ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55822024-11-14T06:22:29.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
55832024-11-14T06:22:29.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55842024-11-14T06:22:29.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55852024-11-14T06:22:29.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55862024-11-14T06:22:29.522ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55872024-11-14T06:22:29.522ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55882024-11-14T06:22:29.522ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55892024-11-14T06:22:29.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55902024-11-14T06:22:29.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
55912024-11-14T06:22:29.524ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55922024-11-14T06:22:29.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55932024-11-14T06:22:29.525ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55942024-11-14T06:22:29.525ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
55952024-11-14T06:22:29.525ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55962024-11-14T06:22:29.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55972024-11-14T06:22:29.526ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55982024-11-14T06:22:29.527ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 135.025073ms iteration = 7 status = 0
55992024-11-14T06:22:29.528ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
56002024-11-14T06:22:29.528ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
56012024-11-14T06:22:29.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56022024-11-14T06:22:29.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56032024-11-14T06:22:29.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56042024-11-14T06:22:29.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56052024-11-14T06:22:29.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56062024-11-14T06:22:29.535ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
56072024-11-14T06:22:29.535ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
56082024-11-14T06:22:29.535ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
56092024-11-14T06:22:29.535ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 143.162554ms iteration = 5 status = {"generation":2}
56102024-11-14T06:22:29.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 143.455041ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56112024-11-14T06:22:29.535ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56122024-11-14T06:22:29.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56132024-11-14T06:22:29.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56142024-11-14T06:22:29.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56152024-11-14T06:22:29.539ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
56162024-11-14T06:22:29.539ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
56172024-11-14T06:22:29.539ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 147.20193ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
56182024-11-14T06:22:29.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 148.977573ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
56192024-11-14T06:22:29.542ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
56202024-11-14T06:22:29.542ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
56212024-11-14T06:22:29.542ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
56222024-11-14T06:22:29.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 150.96438ms iteration = 5 status = {"generation":1}
56232024-11-14T06:22:29.550ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 158.159824ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
56242024-11-14T06:22:29.550ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56252024-11-14T06:22:29.550ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56262024-11-14T06:22:29.550ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 158.606842ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56272024-11-14T06:22:29.562ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
56282024-11-14T06:22:29.562ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 170.013204ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
56292024-11-14T06:22:29.587ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
56302024-11-14T06:22:29.596ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 203.953566ms iteration = 9 status = {"physical_disks_added":0}
56312024-11-14T06:22:29.653ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
56322024-11-14T06:22:29.653ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 261.65295ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
56332024-11-14T06:22:29.670ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
56342024-11-14T06:22:29.670ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56352024-11-14T06:22:29.671ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f08bcf54-07e0-43c2-a750-cb5788957892", "content-length": "26", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
56362024-11-14T06:22:29.671ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56372024-11-14T06:22:29.672ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56382024-11-14T06:22:29.755ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
56392024-11-14T06:22:29.778ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
56402024-11-14T06:22:29.778ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56412024-11-14T06:22:29.778ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd4e5c4d-75f9-4c16-b40c-267a10a9cde0", "content-length": "26", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
56422024-11-14T06:22:29.778ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56432024-11-14T06:22:29.781ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56442024-11-14T06:22:29.793ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
56452024-11-14T06:22:29.793ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56462024-11-14T06:22:29.793ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "df1cc382-db76-4ddf-b9d2-c4be930b59a0", "content-length": "372", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
56472024-11-14T06:22:29.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56482024-11-14T06:22:29.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56492024-11-14T06:22:29.807ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
56502024-11-14T06:22:29.807ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
56512024-11-14T06:22:29.807ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b59e7737-ad87-4193-ac59-40ebfca1aa3a", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
56522024-11-14T06:22:29.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56532024-11-14T06:22:29.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56542024-11-14T06:22:29.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56552024-11-14T06:22:29.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56562024-11-14T06:22:29.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56572024-11-14T06:22:29.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56582024-11-14T06:22:29.816ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56592024-11-14T06:22:29.816ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56602024-11-14T06:22:29.817ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "596bf357-7ca1-40af-92da-8f14bbeb9385", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
56612024-11-14T06:22:29.818ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 426.578269ms iteration = 8 status = {}
56622024-11-14T06:22:29.819ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
56632024-11-14T06:22:29.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56642024-11-14T06:22:29.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
56652024-11-14T06:22:29.821ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56662024-11-14T06:22:29.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56672024-11-14T06:22:29.821ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38a838ef-6acb-4746-9bb8-3b8f273d1582", "content-length": "64", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
56682024-11-14T06:22:29.821ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56692024-11-14T06:22:29.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56702024-11-14T06:22:29.823ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56712024-11-14T06:22:29.824ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
56722024-11-14T06:22:29.824ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56732024-11-14T06:22:29.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
56742024-11-14T06:22:29.830ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
56752024-11-14T06:22:29.830ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56762024-11-14T06:22:29.830ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2e1acbf-8db1-41d0-969a-fdfc8dbfb596", "content-length": "26", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
56772024-11-14T06:22:29.830ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56782024-11-14T06:22:29.831ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
56792024-11-14T06:22:29.834ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 442.7285ms iteration = 3 status = {"nsuccess":5}
56802024-11-14T06:22:29.845ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
56812024-11-14T06:22:29.845ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "63dc4465-9b98-465e-8fdf-f2c581c46c5e", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56822024-11-14T06:22:29.845ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56832024-11-14T06:22:29.847ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "692fafd7-2094-4ef6-a977-9f915c9cb687", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56842024-11-14T06:22:29.847ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56852024-11-14T06:22:29.848ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56862024-11-14T06:22:29.848ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 456.72105ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
56872024-11-14T06:22:29.851ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56882024-11-14T06:22:29.851ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "477e3815-9136-4fee-98e2-88323aba49ee", "content-length": "691", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
56892024-11-14T06:22:29.851ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
56902024-11-14T06:22:29.851ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
56912024-11-14T06:22:29.851ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
56922024-11-14T06:22:29.853ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 461.416868ms iteration = 7 status = {}
56932024-11-14T06:22:30.107ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56942024-11-14T06:22:30.107ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bdb4174-d34c-4abb-8624-336ad16d6e29", "content-length": "1", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
56952024-11-14T06:22:30.109ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56962024-11-14T06:22:30.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56972024-11-14T06:22:30.111ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 719.398691ms iteration = 7 status = null
56982024-11-14T06:22:30.118ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 726.4059ms iteration = 7 status = {}
56992024-11-14T06:22:30.122ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
57002024-11-14T06:22:30.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57012024-11-14T06:22:30.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57022024-11-14T06:22:30.180ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
57032024-11-14T06:22:30.181ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "32cae623-4862-4a76-911c-a4aea6881cd9", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57042024-11-14T06:22:30.181ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57052024-11-14T06:22:30.181ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
57062024-11-14T06:22:30.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57072024-11-14T06:22:30.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57082024-11-14T06:22:30.183ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "501b173e-b7b5-48e5-b039-a26aaea40e37", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57092024-11-14T06:22:30.183ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57102024-11-14T06:22:30.185ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8daa7784-ceb5-4f09-9674-5df0b228504c", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57112024-11-14T06:22:30.185ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57122024-11-14T06:22:30.186ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57132024-11-14T06:22:30.187ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 794.939605ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
57142024-11-14T06:22:30.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57152024-11-14T06:22:30.191ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c07ff02c-872b-4d29-a8b1-271270924d89", "content-length": "134", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
57162024-11-14T06:22:30.191ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57172024-11-14T06:22:30.191ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
57182024-11-14T06:22:30.191ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57192024-11-14T06:22:30.191ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57202024-11-14T06:22:30.191ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57212024-11-14T06:22:30.191ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57222024-11-14T06:22:30.191ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57232024-11-14T06:22:30.191ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57242024-11-14T06:22:30.191ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57252024-11-14T06:22:30.191ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57262024-11-14T06:22:30.192ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
57272024-11-14T06:22:30.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57282024-11-14T06:22:30.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57292024-11-14T06:22:30.194ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57302024-11-14T06:22:30.194ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ce0cf3c-f385-4e79-b47f-9cfefc4bf667", "content-length": "2", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
57312024-11-14T06:22:30.194ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57322024-11-14T06:22:30.194ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad9996d2-15d6-438a-b5f3-3f1fba19969c", "content-length": "52", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
57332024-11-14T06:22:30.194ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
57342024-11-14T06:22:30.194ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57352024-11-14T06:22:30.346ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bd1b9eab-db70-4e7f-b380-b7fa311cb556", "date": "Thu, 14 Nov 2024 06:22:29 GMT"} })
57362024-11-14T06:22:30.346ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
57372024-11-14T06:22:30.346ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57382024-11-14T06:22:30.346ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c58c7285-d230-49e0-b5dc-4aaa7c0acc85", "content-length": "682", "date": "Thu, 14 Nov 2024 06:22:30 GMT"} })
57392024-11-14T06:22:30.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57402024-11-14T06:22:30.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57412024-11-14T06:22:30.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57422024-11-14T06:22:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57432024-11-14T06:22:30.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57442024-11-14T06:22:30.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57452024-11-14T06:22:30.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57462024-11-14T06:22:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57472024-11-14T06:22:30.363ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 971.114665ms iteration = 7 status = {}
57482024-11-14T06:22:37.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1077 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 4f87e1f5-f634-4424-8f51-e5ebf89cc88d response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
57492024-11-14T06:22:39.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
57502024-11-14T06:22:39.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57512024-11-14T06:22:39.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
57522024-11-14T06:22:39.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57532024-11-14T06:22:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57542024-11-14T06:22:39.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57552024-11-14T06:22:39.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57562024-11-14T06:22:39.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57572024-11-14T06:22:39.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57582024-11-14T06:22:39.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57592024-11-14T06:22:39.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57602024-11-14T06:22:39.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57612024-11-14T06:22:39.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57622024-11-14T06:22:39.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57632024-11-14T06:22:39.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57642024-11-14T06:22:39.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
57652024-11-14T06:22:39.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57662024-11-14T06:22:39.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57672024-11-14T06:22:39.411ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
57682024-11-14T06:22:39.411ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.663776ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
57692024-11-14T06:22:39.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.927135ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57702024-11-14T06:22:42.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 421ef104-8605-4e6e-8480-b86b6393d5d2 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
57712024-11-14T06:22:42.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 421ef104-8605-4e6e-8480-b86b6393d5d2 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
57722024-11-14T06:22:42.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 421ef104-8605-4e6e-8480-b86b6393d5d2 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
57732024-11-14T06:22:42.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 22c84fce-37a7-44e5-95d1-f5ad6c8ad2f2 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
57742024-11-14T06:22:42.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 22c84fce-37a7-44e5-95d1-f5ad6c8ad2f2 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
57752024-11-14T06:22:42.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 22c84fce-37a7-44e5-95d1-f5ad6c8ad2f2 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
57762024-11-14T06:22:49.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
57772024-11-14T06:22:49.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57782024-11-14T06:22:49.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
57792024-11-14T06:22:49.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57802024-11-14T06:22:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57812024-11-14T06:22:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57822024-11-14T06:22:49.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57832024-11-14T06:22:49.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57842024-11-14T06:22:49.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57852024-11-14T06:22:49.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57862024-11-14T06:22:49.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57872024-11-14T06:22:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57882024-11-14T06:22:49.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.259269ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57892024-11-14T06:22:49.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57902024-11-14T06:22:49.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57912024-11-14T06:22:49.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922024-11-14T06:22:49.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
57932024-11-14T06:22:49.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57942024-11-14T06:22:49.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57952024-11-14T06:22:49.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
57962024-11-14T06:22:49.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.488011ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
57972024-11-14T06:22:52.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1158 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = d2222485-7955-4eb5-9d84-d811bf476269 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
57982024-11-14T06:22:57.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 7cd966d0-7429-423d-ae58-ad34e9a92d85 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
57992024-11-14T06:22:57.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 7cd966d0-7429-423d-ae58-ad34e9a92d85 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
58002024-11-14T06:22:57.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2667 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 7cd966d0-7429-423d-ae58-ad34e9a92d85 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
58012024-11-14T06:22:57.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 2b1d2349-90dd-4bc2-8b84-afb235878c6c roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
58022024-11-14T06:22:57.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 2b1d2349-90dd-4bc2-8b84-afb235878c6c resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
58032024-11-14T06:22:57.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 2b1d2349-90dd-4bc2-8b84-afb235878c6c response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
58042024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
58052024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58062024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
58072024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58082024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
58092024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58102024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
58112024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
58122024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58132024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
58142024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58152024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
58162024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
58172024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58182024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
58192024-11-14T06:22:59.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58202024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58212024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
58222024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
58232024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58242024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58252024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
58262024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58272024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
58282024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58292024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58302024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
58312024-11-14T06:22:59.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58322024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58332024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
58342024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58352024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
58362024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58372024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
58382024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58392024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58402024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58412024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58422024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58432024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58442024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58452024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58462024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58472024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58482024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58492024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58502024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58512024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58522024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58532024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58542024-11-14T06:22:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58552024-11-14T06:22:59.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58562024-11-14T06:22:59.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58572024-11-14T06:22:59.394ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58582024-11-14T06:22:59.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58592024-11-14T06:22:59.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.470015ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58602024-11-14T06:22:59.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58612024-11-14T06:22:59.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58622024-11-14T06:22:59.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58632024-11-14T06:22:59.396ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 954323742 } })
58642024-11-14T06:22:59.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58652024-11-14T06:22:59.396ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58662024-11-14T06:22:59.396ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
58672024-11-14T06:22:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58682024-11-14T06:22:59.398ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58692024-11-14T06:22:59.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58702024-11-14T06:22:59.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58712024-11-14T06:22:59.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58722024-11-14T06:22:59.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58732024-11-14T06:22:59.401ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58742024-11-14T06:22:59.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58752024-11-14T06:22:59.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58762024-11-14T06:22:59.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58772024-11-14T06:22:59.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58782024-11-14T06:22:59.402ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 960493586 } })
58792024-11-14T06:22:59.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
58802024-11-14T06:22:59.403ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58812024-11-14T06:22:59.403ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.760329ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
58822024-11-14T06:22:59.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58832024-11-14T06:22:59.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58842024-11-14T06:22:59.406ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58852024-11-14T06:22:59.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58862024-11-14T06:22:59.407ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 965030321 } })
58872024-11-14T06:22:59.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58882024-11-14T06:22:59.407ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
58892024-11-14T06:22:59.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58902024-11-14T06:22:59.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58912024-11-14T06:22:59.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58922024-11-14T06:22:59.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58932024-11-14T06:22:59.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58942024-11-14T06:22:59.410ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58952024-11-14T06:22:59.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58962024-11-14T06:22:59.411ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58972024-11-14T06:22:59.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58982024-11-14T06:22:59.413ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58992024-11-14T06:22:59.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59002024-11-14T06:22:59.414ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59012024-11-14T06:22:59.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59022024-11-14T06:22:59.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59032024-11-14T06:22:59.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59042024-11-14T06:22:59.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59052024-11-14T06:22:59.448ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59062024-11-14T06:22:59.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59072024-11-14T06:22:59.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.182896ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
59082024-11-14T06:22:59.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.183689ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59092024-11-14T06:22:59.462ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.077884ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59102024-11-14T06:22:59.462ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59112024-11-14T06:22:59.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59122024-11-14T06:22:59.463ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59132024-11-14T06:22:59.463ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59142024-11-14T06:22:59.463ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59152024-11-14T06:22:59.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59162024-11-14T06:22:59.465ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 73.62242ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59172024-11-14T06:22:59.465ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59182024-11-14T06:22:59.465ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.022848ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59192024-11-14T06:22:59.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59202024-11-14T06:22:59.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59212024-11-14T06:22:59.475ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59222024-11-14T06:22:59.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59232024-11-14T06:22:59.479ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59242024-11-14T06:22:59.480ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 88.363235ms iteration = 10 status = {"physical_disks_added":0}
59252024-11-14T06:22:59.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
59262024-11-14T06:22:59.482ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59272024-11-14T06:22:59.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59282024-11-14T06:22:59.493ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59292024-11-14T06:22:59.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59302024-11-14T06:22:59.508ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59312024-11-14T06:22:59.508ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59322024-11-14T06:22:59.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59332024-11-14T06:22:59.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59342024-11-14T06:22:59.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59352024-11-14T06:22:59.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59362024-11-14T06:22:59.540ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
59372024-11-14T06:22:59.540ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59382024-11-14T06:22:59.540ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77649ed4-161f-4283-aa02-01dfe20c9faa", "content-length": "26", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
59392024-11-14T06:22:59.540ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59402024-11-14T06:22:59.541ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
59412024-11-14T06:22:59.585ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59422024-11-14T06:22:59.585ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59432024-11-14T06:22:59.586ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e508c734-eeaa-4910-a491-ff7743ce8aa5", "content-length": "372", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
59442024-11-14T06:22:59.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59452024-11-14T06:22:59.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59462024-11-14T06:22:59.587ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59472024-11-14T06:22:59.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 197.122208ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59482024-11-14T06:22:59.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
59492024-11-14T06:22:59.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59502024-11-14T06:22:59.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59512024-11-14T06:22:59.591ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59522024-11-14T06:22:59.591ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59532024-11-14T06:22:59.591ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 199.485683ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59542024-11-14T06:22:59.594ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 202.837044ms iteration = 8 status = 0
59552024-11-14T06:22:59.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
59562024-11-14T06:22:59.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 208.390309ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
59572024-11-14T06:22:59.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59582024-11-14T06:22:59.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59592024-11-14T06:22:59.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59602024-11-14T06:22:59.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59612024-11-14T06:22:59.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59622024-11-14T06:22:59.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59632024-11-14T06:22:59.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59642024-11-14T06:22:59.609ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
59652024-11-14T06:22:59.609ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59662024-11-14T06:22:59.609ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25e33807-009d-4a43-87b2-184ac1984f9b", "content-length": "26", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
59672024-11-14T06:22:59.609ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59682024-11-14T06:22:59.609ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
59692024-11-14T06:22:59.609ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59702024-11-14T06:22:59.610ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d398e9fa-805c-4894-9bcd-95b7537cb715", "content-length": "26", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
59712024-11-14T06:22:59.610ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59722024-11-14T06:22:59.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59732024-11-14T06:22:59.610ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59742024-11-14T06:22:59.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59752024-11-14T06:22:59.612ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59762024-11-14T06:22:59.615ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59772024-11-14T06:22:59.663ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
59782024-11-14T06:22:59.663ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59792024-11-14T06:22:59.663ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ffc3d1d9-f05c-45ac-a619-2904c00ab29c", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
59802024-11-14T06:22:59.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59812024-11-14T06:22:59.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59822024-11-14T06:22:59.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59832024-11-14T06:22:59.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59842024-11-14T06:22:59.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59852024-11-14T06:22:59.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59862024-11-14T06:22:59.675ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59872024-11-14T06:22:59.675ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59882024-11-14T06:22:59.675ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a31077be-7161-4d55-aa39-8d92a065ab6b", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
59892024-11-14T06:22:59.677ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 285.34391ms iteration = 9 status = {}
59902024-11-14T06:22:59.744ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59912024-11-14T06:22:59.745ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a26e8413-c0a8-4fdd-9222-51455a261942", "content-length": "1", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
59922024-11-14T06:22:59.747ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59932024-11-14T06:22:59.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59942024-11-14T06:22:59.749ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 357.125537ms iteration = 8 status = null
59952024-11-14T06:22:59.752ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59962024-11-14T06:22:59.752ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2784310-b520-4f75-952e-c2eb637e9dfd", "content-length": "691", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
59972024-11-14T06:22:59.752ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
59982024-11-14T06:22:59.752ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
59992024-11-14T06:22:59.753ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
60002024-11-14T06:22:59.755ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 363.486375ms iteration = 8 status = {}
60012024-11-14T06:22:59.756ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:60585
60022024-11-14T06:22:59.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60585 req_id = 1a1eb33b-6631-43ea-9e61-4a6164b16baf roles = RoleSet { roles: {} } uri = /metrics/producers
60032024-11-14T06:22:59.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60585 req_id = 1a1eb33b-6631-43ea-9e61-4a6164b16baf resource = Database result = Ok(()) uri = /metrics/producers
60042024-11-14T06:22:59.805ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 07d948d3-6a47-45eb-9ed3-629b45d23b8a
60052024-11-14T06:22:59.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48721 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60585 req_id = 1a1eb33b-6631-43ea-9e61-4a6164b16baf response_code = 201 uri = /metrics/producers
60062024-11-14T06:22:59.827ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 435.454215ms iteration = 8 status = {}
60072024-11-14T06:22:59.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60082024-11-14T06:22:59.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60092024-11-14T06:22:59.871ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
60102024-11-14T06:22:59.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60112024-11-14T06:22:59.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60122024-11-14T06:22:59.879ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60132024-11-14T06:22:59.880ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc689d33-c162-42f1-a756-95a5b072e8b4", "content-length": "134", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
60142024-11-14T06:22:59.880ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60152024-11-14T06:22:59.880ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
60162024-11-14T06:22:59.880ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60172024-11-14T06:22:59.880ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60182024-11-14T06:22:59.880ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60192024-11-14T06:22:59.880ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60202024-11-14T06:22:59.880ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60212024-11-14T06:22:59.880ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60222024-11-14T06:22:59.880ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60232024-11-14T06:22:59.880ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60242024-11-14T06:22:59.881ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
60252024-11-14T06:22:59.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60262024-11-14T06:22:59.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60272024-11-14T06:22:59.882ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60282024-11-14T06:22:59.882ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4213e09-b6da-4abf-9544-4b485c7accd7", "content-length": "2", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
60292024-11-14T06:22:59.882ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60302024-11-14T06:22:59.882ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d598e83-5e44-4f2f-aaae-1245a077dc26", "content-length": "52", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
60312024-11-14T06:22:59.882ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
60322024-11-14T06:22:59.882ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60332024-11-14T06:23:00.071ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "39245e86-8b7e-4953-8e06-198fd129b133", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
60342024-11-14T06:23:00.071ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
60352024-11-14T06:23:00.071ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60362024-11-14T06:23:00.071ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "136b2b4b-6815-40ce-8b50-5f7fa43167be", "content-length": "682", "date": "Thu, 14 Nov 2024 06:22:59 GMT"} })
60372024-11-14T06:23:00.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60382024-11-14T06:23:00.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60392024-11-14T06:23:00.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60402024-11-14T06:23:00.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60412024-11-14T06:23:00.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60422024-11-14T06:23:00.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60432024-11-14T06:23:00.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60442024-11-14T06:23:00.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60452024-11-14T06:23:00.089ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 697.870479ms iteration = 8 status = {}
60462024-11-14T06:23:07.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1185 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = defb3be5-7e88-437d-9290-f1d93ac00d71 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
60472024-11-14T06:23:09.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
60482024-11-14T06:23:09.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
60492024-11-14T06:23:09.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60502024-11-14T06:23:09.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60512024-11-14T06:23:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60522024-11-14T06:23:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60532024-11-14T06:23:09.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60542024-11-14T06:23:09.395ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60552024-11-14T06:23:09.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60562024-11-14T06:23:09.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60572024-11-14T06:23:09.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60582024-11-14T06:23:09.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.573355ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60592024-11-14T06:23:09.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60602024-11-14T06:23:09.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60612024-11-14T06:23:09.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60622024-11-14T06:23:09.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60632024-11-14T06:23:09.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
60642024-11-14T06:23:09.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60652024-11-14T06:23:09.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60662024-11-14T06:23:09.410ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
60672024-11-14T06:23:09.410ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.546027ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
60682024-11-14T06:23:12.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = afe0f114-a5bd-45b4-914c-047c3d40fcd5 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
60692024-11-14T06:23:12.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = afe0f114-a5bd-45b4-914c-047c3d40fcd5 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
60702024-11-14T06:23:12.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = afe0f114-a5bd-45b4-914c-047c3d40fcd5 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
60712024-11-14T06:23:12.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = f440337e-c6e6-4d30-8303-9aa7e411af8c roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
60722024-11-14T06:23:12.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = f440337e-c6e6-4d30-8303-9aa7e411af8c resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
60732024-11-14T06:23:12.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = f440337e-c6e6-4d30-8303-9aa7e411af8c response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
60742024-11-14T06:23:19.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
60752024-11-14T06:23:19.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60762024-11-14T06:23:19.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
60772024-11-14T06:23:19.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60782024-11-14T06:23:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60792024-11-14T06:23:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60802024-11-14T06:23:19.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60812024-11-14T06:23:19.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60822024-11-14T06:23:19.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60832024-11-14T06:23:19.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.75633ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60842024-11-14T06:23:19.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60852024-11-14T06:23:19.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60862024-11-14T06:23:19.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60872024-11-14T06:23:19.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60882024-11-14T06:23:19.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60892024-11-14T06:23:19.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60902024-11-14T06:23:19.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
60912024-11-14T06:23:19.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60922024-11-14T06:23:19.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60932024-11-14T06:23:19.415ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
60942024-11-14T06:23:19.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.730313ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
60952024-11-14T06:23:22.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1565 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 52fdb898-2eaa-477c-9c8b-6f0a2bcdc8aa response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
60962024-11-14T06:23:23.221ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:37341
60972024-11-14T06:23:23.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37341 req_id = 1c1ad52a-0328-4523-a835-1bd40bbcc210 roles = RoleSet { roles: {} } uri = /metrics/producers
60982024-11-14T06:23:23.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37341 req_id = 1c1ad52a-0328-4523-a835-1bd40bbcc210 resource = Database result = Ok(()) uri = /metrics/producers
60992024-11-14T06:23:23.258ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6826e3df-ce47-4da7-be1a-7b4ea7b6cca4
61002024-11-14T06:23:23.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36726 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37341 req_id = 1c1ad52a-0328-4523-a835-1bd40bbcc210 response_code = 201 uri = /metrics/producers
61012024-11-14T06:23:27.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 84351226-79e1-4f9d-8e1b-dc3306db3e64 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
61022024-11-14T06:23:27.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 84351226-79e1-4f9d-8e1b-dc3306db3e64 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
61032024-11-14T06:23:27.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 84351226-79e1-4f9d-8e1b-dc3306db3e64 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
61042024-11-14T06:23:27.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 458a2e9e-307a-4399-9826-98b4adc90ca0 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
61052024-11-14T06:23:27.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 458a2e9e-307a-4399-9826-98b4adc90ca0 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
61062024-11-14T06:23:27.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 458a2e9e-307a-4399-9826-98b4adc90ca0 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
61072024-11-14T06:23:29.267ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36165
61082024-11-14T06:23:29.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36165 req_id = 7c6d78b9-bdd6-45fa-b190-80c4c78a4852 roles = RoleSet { roles: {} } uri = /metrics/producers
61092024-11-14T06:23:29.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36165 req_id = 7c6d78b9-bdd6-45fa-b190-80c4c78a4852 resource = Database result = Ok(()) uri = /metrics/producers
61102024-11-14T06:23:29.281ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6cb81177-384c-420e-b49a-7c6450fab666
61112024-11-14T06:23:29.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13136 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36165 req_id = 7c6d78b9-bdd6-45fa-b190-80c4c78a4852 response_code = 201 uri = /metrics/producers
61122024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
61132024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
61142024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61152024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
61162024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61172024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
61182024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61192024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
61202024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61212024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
61222024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
61232024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
61242024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61252024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61262024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
61272024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
61282024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61292024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
61302024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61312024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
61322024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61332024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
61342024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
61352024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61362024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
61372024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61382024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
61392024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
61402024-11-14T06:23:29.391ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
61412024-11-14T06:23:29.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61422024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61432024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
61442024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
61452024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
61462024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
61472024-11-14T06:23:29.392ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:13:29.391979281 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61482024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61492024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
61502024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61512024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61522024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
61532024-11-14T06:23:29.392ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
61542024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.28\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
61552024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
61562024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
61572024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
61582024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61592024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61602024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61612024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
61622024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
61632024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61642024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
61652024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
61662024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61672024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61682024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
61692024-11-14T06:23:29.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61702024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61712024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
61722024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61732024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61742024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61752024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61762024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61772024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61782024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61792024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61802024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61812024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61822024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61832024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61842024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61852024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
61862024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
61872024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61882024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61892024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61902024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
61912024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61922024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61932024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61942024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61952024-11-14T06:23:29.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 950252136 } })
61962024-11-14T06:23:29.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 950272506 } })
61972024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61982024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61992024-11-14T06:23:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62002024-11-14T06:23:29.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
62012024-11-14T06:23:29.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.0944ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
62022024-11-14T06:23:29.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
62032024-11-14T06:23:29.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.322514ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
62042024-11-14T06:23:29.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62052024-11-14T06:23:29.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62062024-11-14T06:23:29.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62072024-11-14T06:23:29.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62082024-11-14T06:23:29.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62092024-11-14T06:23:29.396ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.180668ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62102024-11-14T06:23:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62112024-11-14T06:23:29.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62122024-11-14T06:23:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62132024-11-14T06:23:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62142024-11-14T06:23:29.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62152024-11-14T06:23:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62162024-11-14T06:23:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62172024-11-14T06:23:29.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62182024-11-14T06:23:29.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62192024-11-14T06:23:29.399ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62202024-11-14T06:23:29.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62212024-11-14T06:23:29.400ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62222024-11-14T06:23:29.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62232024-11-14T06:23:29.402ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62242024-11-14T06:23:29.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62252024-11-14T06:23:29.402ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:13:29.391979281 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
62262024-11-14T06:23:29.402ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.654699ms iteration = 5 status = {"expiration":"2024-11-14T06:13:29.391979281Z","pruned":[]}
62272024-11-14T06:23:29.402ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.802741ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
62282024-11-14T06:23:29.403ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62292024-11-14T06:23:29.404ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62302024-11-14T06:23:29.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62312024-11-14T06:23:29.405ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62322024-11-14T06:23:29.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62332024-11-14T06:23:29.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 963327169 } })
62342024-11-14T06:23:29.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
62352024-11-14T06:23:29.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
62362024-11-14T06:23:29.406ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62372024-11-14T06:23:29.406ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
62382024-11-14T06:23:29.406ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
62392024-11-14T06:23:29.406ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.570381ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
62402024-11-14T06:23:29.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62412024-11-14T06:23:29.408ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62422024-11-14T06:23:29.409ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 967098209 } })
62432024-11-14T06:23:29.409ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
62442024-11-14T06:23:29.410ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62452024-11-14T06:23:29.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62462024-11-14T06:23:29.411ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62472024-11-14T06:23:29.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62482024-11-14T06:23:29.413ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62492024-11-14T06:23:29.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62502024-11-14T06:23:29.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62512024-11-14T06:23:29.413ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62522024-11-14T06:23:29.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62532024-11-14T06:23:29.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62542024-11-14T06:23:29.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62552024-11-14T06:23:29.420ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62562024-11-14T06:23:29.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62572024-11-14T06:23:29.421ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62582024-11-14T06:23:29.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62592024-11-14T06:23:29.421ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62602024-11-14T06:23:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62612024-11-14T06:23:29.422ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 980306645 } })
62622024-11-14T06:23:29.423ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
62632024-11-14T06:23:29.424ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62642024-11-14T06:23:29.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62652024-11-14T06:23:29.424ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62662024-11-14T06:23:29.424ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62672024-11-14T06:23:29.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62682024-11-14T06:23:29.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62692024-11-14T06:23:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62702024-11-14T06:23:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
62712024-11-14T06:23:29.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62722024-11-14T06:23:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62732024-11-14T06:23:29.435ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62742024-11-14T06:23:29.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62752024-11-14T06:23:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
62762024-11-14T06:23:29.439ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62772024-11-14T06:23:29.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62782024-11-14T06:23:29.440ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62792024-11-14T06:23:29.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62802024-11-14T06:23:29.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62812024-11-14T06:23:29.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62822024-11-14T06:23:29.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62832024-11-14T06:23:29.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62842024-11-14T06:23:29.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62852024-11-14T06:23:29.457ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62862024-11-14T06:23:29.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62872024-11-14T06:23:29.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.882203ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
62882024-11-14T06:23:29.463ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
62892024-11-14T06:23:29.463ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.613733ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
62902024-11-14T06:23:29.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.567715ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
62912024-11-14T06:23:29.471ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62922024-11-14T06:23:29.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62932024-11-14T06:23:29.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62942024-11-14T06:23:29.475ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.942392ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62952024-11-14T06:23:29.475ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62962024-11-14T06:23:29.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62972024-11-14T06:23:29.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62982024-11-14T06:23:29.480ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 88.980546ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
62992024-11-14T06:23:29.483ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63002024-11-14T06:23:29.483ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63012024-11-14T06:23:29.483ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63022024-11-14T06:23:29.483ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63032024-11-14T06:23:29.483ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
63042024-11-14T06:23:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63052024-11-14T06:23:29.483ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 91.762958ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63062024-11-14T06:23:29.486ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63072024-11-14T06:23:29.486ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63082024-11-14T06:23:29.486ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63092024-11-14T06:23:29.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63102024-11-14T06:23:29.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63112024-11-14T06:23:29.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63122024-11-14T06:23:29.489ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.629137ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63132024-11-14T06:23:29.490ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63142024-11-14T06:23:29.490ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 98.86131ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63152024-11-14T06:23:29.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63162024-11-14T06:23:29.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63172024-11-14T06:23:29.505ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63182024-11-14T06:23:29.505ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63192024-11-14T06:23:29.505ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63202024-11-14T06:23:29.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63212024-11-14T06:23:29.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63222024-11-14T06:23:29.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63232024-11-14T06:23:29.509ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63242024-11-14T06:23:29.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63252024-11-14T06:23:29.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63262024-11-14T06:23:29.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63272024-11-14T06:23:29.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63282024-11-14T06:23:29.513ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63292024-11-14T06:23:29.514ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63302024-11-14T06:23:29.514ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63312024-11-14T06:23:29.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63322024-11-14T06:23:29.524ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63332024-11-14T06:23:29.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
63342024-11-14T06:23:29.533ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
63352024-11-14T06:23:29.533ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
63362024-11-14T06:23:29.533ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
63372024-11-14T06:23:29.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63382024-11-14T06:23:29.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63392024-11-14T06:23:29.535ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 143.354198ms iteration = 11 status = {"physical_disks_added":0}
63402024-11-14T06:23:29.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 143.521321ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63412024-11-14T06:23:29.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63422024-11-14T06:23:29.537ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63432024-11-14T06:23:29.537ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63442024-11-14T06:23:29.537ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.670411ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63452024-11-14T06:23:29.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63462024-11-14T06:23:29.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63472024-11-14T06:23:29.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63482024-11-14T06:23:29.543ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
63492024-11-14T06:23:29.543ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
63502024-11-14T06:23:29.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63512024-11-14T06:23:29.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63522024-11-14T06:23:29.544ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
63532024-11-14T06:23:29.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63542024-11-14T06:23:29.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63552024-11-14T06:23:29.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63562024-11-14T06:23:29.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63572024-11-14T06:23:29.552ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
63582024-11-14T06:23:29.552ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
63592024-11-14T06:23:29.552ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
63602024-11-14T06:23:29.552ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 160.747872ms iteration = 6 status = {"generation":2}
63612024-11-14T06:23:29.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63622024-11-14T06:23:29.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
63632024-11-14T06:23:29.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63642024-11-14T06:23:29.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63652024-11-14T06:23:29.561ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
63662024-11-14T06:23:29.561ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63672024-11-14T06:23:29.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63682024-11-14T06:23:29.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63692024-11-14T06:23:29.572ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
63702024-11-14T06:23:29.572ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63712024-11-14T06:23:29.573ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f18a0934-fa9e-4649-9a61-25d51130ddff", "content-length": "26", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} })
63722024-11-14T06:23:29.573ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63732024-11-14T06:23:29.574ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63742024-11-14T06:23:29.576ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
63752024-11-14T06:23:29.576ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 184.226129ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
63762024-11-14T06:23:29.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63772024-11-14T06:23:29.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63782024-11-14T06:23:29.590ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
63792024-11-14T06:23:29.590ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63802024-11-14T06:23:29.590ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fa19ecc-8915-4f6f-9a2d-8d2b47d4be97", "content-length": "26", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} })
63812024-11-14T06:23:29.590ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63822024-11-14T06:23:29.592ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
63832024-11-14T06:23:29.606ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
63842024-11-14T06:23:29.607ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 214.880259ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
63852024-11-14T06:23:29.684ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
63862024-11-14T06:23:29.704ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
63872024-11-14T06:23:29.704ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63882024-11-14T06:23:29.707ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f26eccb1-87f8-4ec8-bfe5-6e2886371693", "content-length": "26", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} })
63892024-11-14T06:23:29.707ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63902024-11-14T06:23:29.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63912024-11-14T06:23:29.750ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63922024-11-14T06:23:29.750ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63932024-11-14T06:23:29.751ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b198bfe4-5cc3-47af-b93b-75002cc0a25c", "content-length": "372", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} })
63942024-11-14T06:23:29.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63952024-11-14T06:23:29.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63962024-11-14T06:23:29.751ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
63972024-11-14T06:23:29.752ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "53e976e1-8437-45f9-9775-c04d02a3dfa2", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63982024-11-14T06:23:29.752ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63992024-11-14T06:23:29.753ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 361.02848ms iteration = 9 status = 0
64002024-11-14T06:23:29.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64012024-11-14T06:23:29.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64022024-11-14T06:23:29.754ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "62e0316d-2004-47a9-a3a8-8e32495c3d3b", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64032024-11-14T06:23:29.754ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64042024-11-14T06:23:29.756ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64052024-11-14T06:23:29.756ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64062024-11-14T06:23:29.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64072024-11-14T06:23:29.757ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64082024-11-14T06:23:29.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64092024-11-14T06:23:29.757ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 365.079515ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
64102024-11-14T06:23:29.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64112024-11-14T06:23:29.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64122024-11-14T06:23:29.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64132024-11-14T06:23:29.759ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64142024-11-14T06:23:29.759ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64152024-11-14T06:23:29.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64162024-11-14T06:23:29.760ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
64172024-11-14T06:23:29.760ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
64182024-11-14T06:23:29.760ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
64192024-11-14T06:23:29.760ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 368.475188ms iteration = 6 status = {"generation":1}
64202024-11-14T06:23:29.771ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 378.975054ms iteration = 9 status = {}
64212024-11-14T06:23:29.796ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
64222024-11-14T06:23:29.796ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64232024-11-14T06:23:29.796ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "19d4798d-ae8c-4f0f-a9b8-5351c5f8b52d", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} })
64242024-11-14T06:23:29.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64252024-11-14T06:23:29.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64262024-11-14T06:23:29.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64272024-11-14T06:23:29.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64282024-11-14T06:23:29.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64292024-11-14T06:23:29.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64302024-11-14T06:23:29.806ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64312024-11-14T06:23:29.806ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64322024-11-14T06:23:29.806ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bfd331f1-2d06-4855-a5b0-2e5f1073e309", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} })
64332024-11-14T06:23:29.808ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 416.446782ms iteration = 10 status = {}
64342024-11-14T06:23:29.830ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
64352024-11-14T06:23:29.889ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64362024-11-14T06:23:29.889ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "60fe635a-097d-4758-ad29-53eb5c380386", "content-length": "691", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} })
64372024-11-14T06:23:29.889ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
64382024-11-14T06:23:29.889ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
64392024-11-14T06:23:29.889ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
64402024-11-14T06:23:29.890ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 498.932126ms iteration = 9 status = {}
64412024-11-14T06:23:29.948ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
64422024-11-14T06:23:29.948ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "351ab5aa-dddf-48ff-8d82-9dc93627f816", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64432024-11-14T06:23:29.948ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64442024-11-14T06:23:29.950ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2fc4583b-4e3d-4701-ac34-b353430d551f", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64452024-11-14T06:23:29.950ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64462024-11-14T06:23:29.952ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a9bf7650-eae0-4362-9eea-52ac2e2140ca", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64472024-11-14T06:23:29.952ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64482024-11-14T06:23:29.954ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64492024-11-14T06:23:29.954ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 563.126851ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
64502024-11-14T06:23:29.955ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64512024-11-14T06:23:29.955ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f126a6c-f3cb-4265-bf98-52c5cdb1d037", "content-length": "1", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} })
64522024-11-14T06:23:29.957ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64532024-11-14T06:23:29.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64542024-11-14T06:23:29.959ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 567.585335ms iteration = 9 status = null
64552024-11-14T06:23:29.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64562024-11-14T06:23:29.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64572024-11-14T06:23:29.997ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
64582024-11-14T06:23:29.997ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64592024-11-14T06:23:29.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64602024-11-14T06:23:30.007ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64612024-11-14T06:23:30.008ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "11a0889b-3a78-40f7-8c84-637e573f63f8", "content-length": "134", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} })
64622024-11-14T06:23:30.008ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64632024-11-14T06:23:30.008ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
64642024-11-14T06:23:30.008ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {}}
64652024-11-14T06:23:30.008ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64662024-11-14T06:23:30.008ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64672024-11-14T06:23:30.008ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {}
64682024-11-14T06:23:30.008ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64692024-11-14T06:23:30.008ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64702024-11-14T06:23:30.008ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
64712024-11-14T06:23:30.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64722024-11-14T06:23:30.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64732024-11-14T06:23:30.010ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64742024-11-14T06:23:30.010ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "deffbdd7-db80-41cd-b207-42665bd1b40a", "content-length": "2", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} })
64752024-11-14T06:23:30.011ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64762024-11-14T06:23:30.011ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bae23e75-f651-425c-b529-3ee5338b074f", "content-length": "52", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} })
64772024-11-14T06:23:30.011ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
64782024-11-14T06:23:30.011ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64792024-11-14T06:23:30.110ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ac54539d-2e5a-4637-b5d2-af6e0deaf11e", "date": "Thu, 14 Nov 2024 06:23:29 GMT"} })
64802024-11-14T06:23:30.110ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
64812024-11-14T06:23:30.110ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64822024-11-14T06:23:30.113ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "35960ff9-207b-4354-85e0-b54f40984c46", "content-length": "682", "date": "Thu, 14 Nov 2024 06:23:30 GMT"} })
64832024-11-14T06:23:30.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64842024-11-14T06:23:30.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64852024-11-14T06:23:30.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64862024-11-14T06:23:30.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64872024-11-14T06:23:30.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64882024-11-14T06:23:30.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64892024-11-14T06:23:30.122ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64902024-11-14T06:23:30.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64912024-11-14T06:23:30.129ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 737.587639ms iteration = 9 status = {}
64922024-11-14T06:23:37.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1567 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = d1763a4e-25c5-4f4a-859c-ea37f3557665 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
64932024-11-14T06:23:39.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
64942024-11-14T06:23:39.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64952024-11-14T06:23:39.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
64962024-11-14T06:23:39.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64972024-11-14T06:23:39.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64982024-11-14T06:23:39.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64992024-11-14T06:23:39.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65002024-11-14T06:23:39.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65012024-11-14T06:23:39.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65022024-11-14T06:23:39.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.363281ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65032024-11-14T06:23:39.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65042024-11-14T06:23:39.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65052024-11-14T06:23:39.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65062024-11-14T06:23:39.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65072024-11-14T06:23:39.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65082024-11-14T06:23:39.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65092024-11-14T06:23:39.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
65102024-11-14T06:23:39.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65112024-11-14T06:23:39.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65122024-11-14T06:23:39.414ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
65132024-11-14T06:23:39.414ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.453138ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
65142024-11-14T06:23:42.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 533a9358-6aa1-4608-8dc6-370a559abda3 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
65152024-11-14T06:23:42.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 533a9358-6aa1-4608-8dc6-370a559abda3 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
65162024-11-14T06:23:42.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 533a9358-6aa1-4608-8dc6-370a559abda3 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
65172024-11-14T06:23:42.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 17377041-c791-4975-97ba-d3a7898df9ce roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
65182024-11-14T06:23:42.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 17377041-c791-4975-97ba-d3a7898df9ce resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
65192024-11-14T06:23:42.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 17377041-c791-4975-97ba-d3a7898df9ce response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
65202024-11-14T06:23:49.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
65212024-11-14T06:23:49.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65222024-11-14T06:23:49.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
65232024-11-14T06:23:49.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65242024-11-14T06:23:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65252024-11-14T06:23:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65262024-11-14T06:23:49.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65272024-11-14T06:23:49.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65282024-11-14T06:23:49.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65292024-11-14T06:23:49.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.039535ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65302024-11-14T06:23:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65312024-11-14T06:23:49.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65322024-11-14T06:23:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65332024-11-14T06:23:49.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65342024-11-14T06:23:49.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65352024-11-14T06:23:49.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65362024-11-14T06:23:49.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
65372024-11-14T06:23:49.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65382024-11-14T06:23:49.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65392024-11-14T06:23:49.411ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
65402024-11-14T06:23:49.411ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.711137ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
65412024-11-14T06:23:52.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1030 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = ae0f4cc9-8af7-46f7-9c76-b2acb36c6113 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
65422024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
65432024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
65442024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65452024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65462024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
65472024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
65482024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65492024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
65502024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65512024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65522024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65532024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
65542024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
65552024-11-14T06:23:59.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65562024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65572024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
65582024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65592024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65602024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
65612024-11-14T06:23:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65622024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
65632024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65642024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
65652024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65662024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
65672024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
65682024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65692024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65702024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
65712024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65722024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
65732024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
65742024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65752024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
65762024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65772024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65782024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65792024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65802024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65812024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65822024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65832024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65842024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65852024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65862024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65872024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65882024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65892024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65902024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65912024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65922024-11-14T06:23:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65932024-11-14T06:23:59.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65942024-11-14T06:23:59.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65952024-11-14T06:23:59.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65962024-11-14T06:23:59.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.305432ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65972024-11-14T06:23:59.395ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65982024-11-14T06:23:59.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65992024-11-14T06:23:59.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66002024-11-14T06:23:59.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66012024-11-14T06:23:59.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66022024-11-14T06:23:59.397ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66032024-11-14T06:23:59.397ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66042024-11-14T06:23:59.397ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66052024-11-14T06:23:59.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66062024-11-14T06:23:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66072024-11-14T06:23:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66082024-11-14T06:23:59.397ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66092024-11-14T06:23:59.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66102024-11-14T06:23:59.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66112024-11-14T06:23:59.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66122024-11-14T06:23:59.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66132024-11-14T06:23:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66142024-11-14T06:23:59.399ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66152024-11-14T06:23:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66162024-11-14T06:23:59.399ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66172024-11-14T06:23:59.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66182024-11-14T06:23:59.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66192024-11-14T06:23:59.400ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66202024-11-14T06:23:59.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66212024-11-14T06:23:59.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.286282ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
66222024-11-14T06:23:59.402ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 959783663 } })
66232024-11-14T06:23:59.402ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66242024-11-14T06:23:59.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66252024-11-14T06:23:59.402ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
66262024-11-14T06:23:59.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66272024-11-14T06:23:59.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66282024-11-14T06:23:59.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66292024-11-14T06:23:59.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66302024-11-14T06:23:59.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 962807309 } })
66312024-11-14T06:23:59.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66322024-11-14T06:23:59.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66332024-11-14T06:23:59.405ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
66342024-11-14T06:23:59.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66352024-11-14T06:23:59.405ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.186694ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66362024-11-14T06:23:59.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 963891089 } })
66372024-11-14T06:23:59.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
66382024-11-14T06:23:59.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66392024-11-14T06:23:59.407ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66402024-11-14T06:23:59.407ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66412024-11-14T06:23:59.407ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66422024-11-14T06:23:59.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66432024-11-14T06:23:59.408ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66442024-11-14T06:23:59.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66452024-11-14T06:23:59.409ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 17.099408ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
66462024-11-14T06:23:59.409ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 17.111489ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66472024-11-14T06:23:59.409ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66482024-11-14T06:23:59.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66492024-11-14T06:23:59.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66502024-11-14T06:23:59.414ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66512024-11-14T06:23:59.414ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66522024-11-14T06:23:59.414ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 22.829995ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66532024-11-14T06:23:59.417ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 26.036985ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
66542024-11-14T06:23:59.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66552024-11-14T06:23:59.419ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66562024-11-14T06:23:59.419ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.923749ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66572024-11-14T06:23:59.419ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66582024-11-14T06:23:59.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66592024-11-14T06:23:59.420ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66602024-11-14T06:23:59.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66612024-11-14T06:23:59.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66622024-11-14T06:23:59.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66632024-11-14T06:23:59.421ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66642024-11-14T06:23:59.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66652024-11-14T06:23:59.424ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66662024-11-14T06:23:59.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66672024-11-14T06:23:59.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
66682024-11-14T06:23:59.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66692024-11-14T06:23:59.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66702024-11-14T06:23:59.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.505033ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
66712024-11-14T06:23:59.459ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66722024-11-14T06:23:59.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66732024-11-14T06:23:59.472ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66742024-11-14T06:23:59.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66752024-11-14T06:23:59.528ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
66762024-11-14T06:23:59.528ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66772024-11-14T06:23:59.528ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0ca2bd5-8a44-4224-98fd-b20ece3cc3da", "content-length": "26", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
66782024-11-14T06:23:59.529ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66792024-11-14T06:23:59.530ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
66802024-11-14T06:23:59.532ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
66812024-11-14T06:23:59.532ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66822024-11-14T06:23:59.532ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "14a3dc9a-2e63-4d13-bb5e-240a2d809904", "content-length": "26", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
66832024-11-14T06:23:59.533ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66842024-11-14T06:23:59.534ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66852024-11-14T06:23:59.631ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
66862024-11-14T06:23:59.631ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66872024-11-14T06:23:59.631ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cd5690f-a327-4db8-b12e-069e743874dd", "content-length": "26", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
66882024-11-14T06:23:59.632ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66892024-11-14T06:23:59.634ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66902024-11-14T06:23:59.636ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
66912024-11-14T06:23:59.636ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66922024-11-14T06:23:59.637ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "186796ca-db7c-4962-8f17-c86c7cd69275", "content-length": "372", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
66932024-11-14T06:23:59.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66942024-11-14T06:23:59.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66952024-11-14T06:23:59.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66962024-11-14T06:23:59.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66972024-11-14T06:23:59.656ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
66982024-11-14T06:23:59.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 264.089906ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
66992024-11-14T06:23:59.672ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
67002024-11-14T06:23:59.672ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67012024-11-14T06:23:59.672ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "529e146e-d475-4124-afa6-3921c4621864", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
67022024-11-14T06:23:59.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67032024-11-14T06:23:59.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67042024-11-14T06:23:59.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67052024-11-14T06:23:59.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67062024-11-14T06:23:59.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67072024-11-14T06:23:59.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67082024-11-14T06:23:59.685ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 293.89138ms iteration = 12 status = {"physical_disks_added":0}
67092024-11-14T06:23:59.686ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 294.401199ms iteration = 10 status = {}
67102024-11-14T06:23:59.686ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67112024-11-14T06:23:59.686ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67122024-11-14T06:23:59.687ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c2a5de93-89ed-46c5-9732-bfeb689c738b", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
67132024-11-14T06:23:59.689ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 297.336744ms iteration = 11 status = {}
67142024-11-14T06:23:59.692ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67152024-11-14T06:23:59.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
67162024-11-14T06:23:59.695ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67172024-11-14T06:23:59.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67182024-11-14T06:23:59.697ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 305.525256ms iteration = 10 status = 0
67192024-11-14T06:23:59.714ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67202024-11-14T06:23:59.715ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "eabb0f77-729f-45d3-9ea7-ebeb15abaa39", "content-length": "1", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
67212024-11-14T06:23:59.716ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67222024-11-14T06:23:59.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67232024-11-14T06:23:59.721ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 329.321729ms iteration = 10 status = null
67242024-11-14T06:23:59.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67252024-11-14T06:23:59.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67262024-11-14T06:23:59.751ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
67272024-11-14T06:23:59.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67282024-11-14T06:23:59.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67292024-11-14T06:23:59.764ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
67302024-11-14T06:23:59.764ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "94df447b-c9e6-4388-a4a4-b007c707e02f", "content-length": "134", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
67312024-11-14T06:23:59.764ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
67322024-11-14T06:23:59.764ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
67332024-11-14T06:23:59.765ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
67342024-11-14T06:23:59.765ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67352024-11-14T06:23:59.765ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67362024-11-14T06:23:59.765ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67372024-11-14T06:23:59.765ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67382024-11-14T06:23:59.765ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67392024-11-14T06:23:59.765ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67402024-11-14T06:23:59.765ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67412024-11-14T06:23:59.765ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
67422024-11-14T06:23:59.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67432024-11-14T06:23:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67442024-11-14T06:23:59.768ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67452024-11-14T06:23:59.768ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0be09259-5276-49c8-a0fa-1d05fbf91d74", "content-length": "2", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
67462024-11-14T06:23:59.768ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67472024-11-14T06:23:59.768ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc3163d7-948c-419f-91d8-4604d8e5f545", "content-length": "52", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
67482024-11-14T06:23:59.768ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
67492024-11-14T06:23:59.768ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67502024-11-14T06:23:59.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67512024-11-14T06:23:59.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67522024-11-14T06:23:59.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67532024-11-14T06:23:59.780ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67542024-11-14T06:23:59.780ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67552024-11-14T06:23:59.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67562024-11-14T06:23:59.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67572024-11-14T06:23:59.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67582024-11-14T06:23:59.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67592024-11-14T06:23:59.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67602024-11-14T06:23:59.830ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67612024-11-14T06:23:59.888ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "df0292dc-ae72-4611-a436-c45fdf7c9b66", "content-length": "691", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
67622024-11-14T06:23:59.888ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
67632024-11-14T06:23:59.888ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
67642024-11-14T06:23:59.888ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
67652024-11-14T06:23:59.890ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 498.446107ms iteration = 10 status = {}
67662024-11-14T06:23:59.995ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fe768652-fc30-4da7-8b4f-99b18ceba589", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
67672024-11-14T06:23:59.995ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
67682024-11-14T06:23:59.995ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67692024-11-14T06:23:59.999ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d14253c0-469a-445d-9c54-42616c6dd7f7", "content-length": "682", "date": "Thu, 14 Nov 2024 06:23:59 GMT"} })
67702024-11-14T06:23:59.999ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67712024-11-14T06:23:59.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67722024-11-14T06:24:00.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67732024-11-14T06:24:00.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67742024-11-14T06:24:00.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67752024-11-14T06:24:00.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67762024-11-14T06:24:00.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67772024-11-14T06:24:00.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67782024-11-14T06:24:00.016ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 625.060294ms iteration = 10 status = {}
67792024-11-14T06:24:04.666ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:33603
67802024-11-14T06:24:04.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33603 req_id = a3f99c27-d5ad-459c-b6ff-d7644235c470 roles = RoleSet { roles: {} } uri = /metrics/producers
67812024-11-14T06:24:04.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33603 req_id = a3f99c27-d5ad-459c-b6ff-d7644235c470 resource = Database result = Ok(()) uri = /metrics/producers
67822024-11-14T06:24:04.702ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = f9c06870-e51f-43ae-842e-1fb78f798f41
67832024-11-14T06:24:04.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36144 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33603 req_id = a3f99c27-d5ad-459c-b6ff-d7644235c470 response_code = 201 uri = /metrics/producers
67842024-11-14T06:24:07.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1073 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 2f4c4169-0fec-4ecc-a822-07bab31fbc9d response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
67852024-11-14T06:24:09.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
67862024-11-14T06:24:09.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
67872024-11-14T06:24:09.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67882024-11-14T06:24:09.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67892024-11-14T06:24:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67902024-11-14T06:24:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67912024-11-14T06:24:09.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67922024-11-14T06:24:09.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67932024-11-14T06:24:09.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67942024-11-14T06:24:09.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67952024-11-14T06:24:09.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67962024-11-14T06:24:09.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67972024-11-14T06:24:09.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67982024-11-14T06:24:09.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
67992024-11-14T06:24:09.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68002024-11-14T06:24:09.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68012024-11-14T06:24:09.416ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
68022024-11-14T06:24:09.416ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.428554ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
68032024-11-14T06:24:09.426ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68042024-11-14T06:24:09.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68052024-11-14T06:24:09.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.9742ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68062024-11-14T06:24:19.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
68072024-11-14T06:24:19.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68082024-11-14T06:24:19.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
68092024-11-14T06:24:19.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68102024-11-14T06:24:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68112024-11-14T06:24:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68122024-11-14T06:24:19.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68132024-11-14T06:24:19.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68142024-11-14T06:24:19.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68152024-11-14T06:24:19.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68162024-11-14T06:24:19.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68172024-11-14T06:24:19.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68182024-11-14T06:24:19.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68192024-11-14T06:24:19.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68202024-11-14T06:24:19.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68212024-11-14T06:24:19.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
68222024-11-14T06:24:19.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68232024-11-14T06:24:19.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68242024-11-14T06:24:19.414ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
68252024-11-14T06:24:19.414ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.245665ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
68262024-11-14T06:24:19.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.79641ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68272024-11-14T06:24:22.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1012 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = ef8829fc-a215-4ef9-9066-a5ff48c88fea response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
68282024-11-14T06:24:27.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 26921943-b6ef-4fcb-b465-03aaab83267f roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
68292024-11-14T06:24:27.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 26921943-b6ef-4fcb-b465-03aaab83267f resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
68302024-11-14T06:24:27.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 26921943-b6ef-4fcb-b465-03aaab83267f response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
68312024-11-14T06:24:27.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = a0e6079d-afe2-4a92-9541-7f054a491238 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
68322024-11-14T06:24:27.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = a0e6079d-afe2-4a92-9541-7f054a491238 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
68332024-11-14T06:24:27.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1735 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = a0e6079d-afe2-4a92-9541-7f054a491238 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
68342024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
68352024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68362024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
68372024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
68382024-11-14T06:24:29.392ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
68392024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68402024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68412024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
68422024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68432024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
68442024-11-14T06:24:29.392ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
68452024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
68462024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.311\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
68472024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
68482024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
68492024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
68502024-11-14T06:24:29.392ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
68512024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68522024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68532024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
68542024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
68552024-11-14T06:24:29.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
68562024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
68572024-11-14T06:24:29.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68582024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
68592024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
68602024-11-14T06:24:29.393ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:14:29.392814846 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
68612024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68622024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
68632024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
68642024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
68652024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
68662024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68672024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68682024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
68692024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68702024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
68712024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68722024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
68732024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68742024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
68752024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
68762024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68772024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
68782024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
68792024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68802024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
68812024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
68822024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
68832024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68842024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68852024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
68862024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68872024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
68882024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
68892024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
68902024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
68912024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
68922024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
68932024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
68942024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
68952024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
68962024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68972024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
68982024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68992024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69002024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69012024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69022024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69032024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
69042024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69052024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69062024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69072024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69082024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69092024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69102024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69112024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69122024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
69132024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69142024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69152024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69162024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69172024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69182024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69192024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69202024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69212024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69222024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
69232024-11-14T06:24:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69242024-11-14T06:24:29.393ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1325, tv_nsec: 951367176 } })
69252024-11-14T06:24:29.393ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1325, tv_nsec: 951404367 } })
69262024-11-14T06:24:29.394ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
69272024-11-14T06:24:29.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.186732ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
69282024-11-14T06:24:29.394ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
69292024-11-14T06:24:29.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.368916ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
69302024-11-14T06:24:29.394ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69312024-11-14T06:24:29.396ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1325, tv_nsec: 953919964 } })
69322024-11-14T06:24:29.396ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.689299ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69332024-11-14T06:24:29.396ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
69342024-11-14T06:24:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
69352024-11-14T06:24:29.396ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69362024-11-14T06:24:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69372024-11-14T06:24:29.397ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69382024-11-14T06:24:29.397ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.667277ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
69392024-11-14T06:24:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69402024-11-14T06:24:29.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69412024-11-14T06:24:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69422024-11-14T06:24:29.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69432024-11-14T06:24:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69442024-11-14T06:24:29.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69452024-11-14T06:24:29.401ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69462024-11-14T06:24:29.401ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
69472024-11-14T06:24:29.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69482024-11-14T06:24:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69492024-11-14T06:24:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69502024-11-14T06:24:29.402ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1325, tv_nsec: 960317023 } })
69512024-11-14T06:24:29.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
69522024-11-14T06:24:29.404ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69532024-11-14T06:24:29.404ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:14:29.392814846 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
69542024-11-14T06:24:29.404ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.547255ms iteration = 6 status = {"expiration":"2024-11-14T06:14:29.392814846Z","pruned":[]}
69552024-11-14T06:24:29.404ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69562024-11-14T06:24:29.405ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69572024-11-14T06:24:29.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69582024-11-14T06:24:29.406ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69592024-11-14T06:24:29.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69602024-11-14T06:24:29.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69612024-11-14T06:24:29.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69622024-11-14T06:24:29.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69632024-11-14T06:24:29.408ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69642024-11-14T06:24:29.408ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69652024-11-14T06:24:29.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69662024-11-14T06:24:29.410ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69672024-11-14T06:24:29.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69682024-11-14T06:24:29.413ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
69692024-11-14T06:24:29.413ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
69702024-11-14T06:24:29.413ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.45947ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
69712024-11-14T06:24:29.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69722024-11-14T06:24:29.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69732024-11-14T06:24:29.415ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1325, tv_nsec: 972814056 } })
69742024-11-14T06:24:29.415ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
69752024-11-14T06:24:29.418ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69762024-11-14T06:24:29.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69772024-11-14T06:24:29.418ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69782024-11-14T06:24:29.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69792024-11-14T06:24:29.420ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
69802024-11-14T06:24:29.420ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.099514ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
69812024-11-14T06:24:29.421ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69822024-11-14T06:24:29.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69832024-11-14T06:24:29.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69842024-11-14T06:24:29.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69852024-11-14T06:24:29.425ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69862024-11-14T06:24:29.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69872024-11-14T06:24:29.434ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69882024-11-14T06:24:29.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69892024-11-14T06:24:29.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69902024-11-14T06:24:29.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69912024-11-14T06:24:29.446ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69922024-11-14T06:24:29.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69932024-11-14T06:24:29.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69942024-11-14T06:24:29.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69952024-11-14T06:24:29.457ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69962024-11-14T06:24:29.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69972024-11-14T06:24:29.459ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69982024-11-14T06:24:29.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69992024-11-14T06:24:29.463ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70002024-11-14T06:24:29.468ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70012024-11-14T06:24:29.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70022024-11-14T06:24:29.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
70032024-11-14T06:24:29.469ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70042024-11-14T06:24:29.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70052024-11-14T06:24:29.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70062024-11-14T06:24:29.471ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70072024-11-14T06:24:29.471ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70082024-11-14T06:24:29.471ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70092024-11-14T06:24:29.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70102024-11-14T06:24:29.472ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70112024-11-14T06:24:29.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70122024-11-14T06:24:29.473ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70132024-11-14T06:24:29.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70142024-11-14T06:24:29.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70152024-11-14T06:24:29.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70162024-11-14T06:24:29.474ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70172024-11-14T06:24:29.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70182024-11-14T06:24:29.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70192024-11-14T06:24:29.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70202024-11-14T06:24:29.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70212024-11-14T06:24:29.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.713884ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70222024-11-14T06:24:29.480ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 87.726403ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
70232024-11-14T06:24:29.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 90.384863ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
70242024-11-14T06:24:29.486ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70252024-11-14T06:24:29.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70262024-11-14T06:24:29.486ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
70272024-11-14T06:24:29.486ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
70282024-11-14T06:24:29.486ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 94.207263ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
70292024-11-14T06:24:29.487ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 95.034769ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
70302024-11-14T06:24:29.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70312024-11-14T06:24:29.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70322024-11-14T06:24:29.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70332024-11-14T06:24:29.489ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70342024-11-14T06:24:29.489ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70352024-11-14T06:24:29.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70362024-11-14T06:24:29.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70372024-11-14T06:24:29.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70382024-11-14T06:24:29.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70392024-11-14T06:24:29.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70402024-11-14T06:24:29.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70412024-11-14T06:24:29.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70422024-11-14T06:24:29.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70432024-11-14T06:24:29.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70442024-11-14T06:24:29.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70452024-11-14T06:24:29.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70462024-11-14T06:24:29.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70472024-11-14T06:24:29.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70482024-11-14T06:24:29.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 101.370677ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70492024-11-14T06:24:29.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
70502024-11-14T06:24:29.495ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70512024-11-14T06:24:29.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70522024-11-14T06:24:29.497ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70532024-11-14T06:24:29.497ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70542024-11-14T06:24:29.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70552024-11-14T06:24:29.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70562024-11-14T06:24:29.498ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70572024-11-14T06:24:29.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70582024-11-14T06:24:29.499ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70592024-11-14T06:24:29.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70602024-11-14T06:24:29.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70612024-11-14T06:24:29.501ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70622024-11-14T06:24:29.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70632024-11-14T06:24:29.502ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70642024-11-14T06:24:29.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70652024-11-14T06:24:29.504ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70662024-11-14T06:24:29.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70672024-11-14T06:24:29.506ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70682024-11-14T06:24:29.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
70692024-11-14T06:24:29.511ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70702024-11-14T06:24:29.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70712024-11-14T06:24:29.514ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70722024-11-14T06:24:29.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70732024-11-14T06:24:29.516ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70742024-11-14T06:24:29.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70752024-11-14T06:24:29.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70762024-11-14T06:24:29.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70772024-11-14T06:24:29.520ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70782024-11-14T06:24:29.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70792024-11-14T06:24:29.521ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
70802024-11-14T06:24:29.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
70812024-11-14T06:24:29.525ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70822024-11-14T06:24:29.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70832024-11-14T06:24:29.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70842024-11-14T06:24:29.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70852024-11-14T06:24:29.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 138.791374ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
70862024-11-14T06:24:29.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70872024-11-14T06:24:29.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70882024-11-14T06:24:29.541ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70892024-11-14T06:24:29.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70902024-11-14T06:24:29.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70912024-11-14T06:24:29.543ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70922024-11-14T06:24:29.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70932024-11-14T06:24:29.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70942024-11-14T06:24:29.544ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
70952024-11-14T06:24:29.544ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70962024-11-14T06:24:29.544ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9412ebb9-7490-418d-938c-11c1fac0858b", "content-length": "26", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} })
70972024-11-14T06:24:29.544ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70982024-11-14T06:24:29.546ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70992024-11-14T06:24:29.546ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71002024-11-14T06:24:29.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
71012024-11-14T06:24:29.547ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71022024-11-14T06:24:29.547ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
71032024-11-14T06:24:29.547ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
71042024-11-14T06:24:29.547ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
71052024-11-14T06:24:29.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71062024-11-14T06:24:29.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71072024-11-14T06:24:29.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71082024-11-14T06:24:29.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
71092024-11-14T06:24:29.548ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71102024-11-14T06:24:29.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71112024-11-14T06:24:29.551ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71122024-11-14T06:24:29.551ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71132024-11-14T06:24:29.551ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 158.790845ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71142024-11-14T06:24:29.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
71152024-11-14T06:24:29.553ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71162024-11-14T06:24:29.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71172024-11-14T06:24:29.555ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71182024-11-14T06:24:29.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71192024-11-14T06:24:29.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71202024-11-14T06:24:29.555ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 162.80175ms iteration = 11 status = 0
71212024-11-14T06:24:29.556ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71222024-11-14T06:24:29.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71232024-11-14T06:24:29.556ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71242024-11-14T06:24:29.558ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71252024-11-14T06:24:29.558ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71262024-11-14T06:24:29.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71272024-11-14T06:24:29.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71282024-11-14T06:24:29.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71292024-11-14T06:24:29.559ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
71302024-11-14T06:24:29.559ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
71312024-11-14T06:24:29.559ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
71322024-11-14T06:24:29.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71332024-11-14T06:24:29.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71342024-11-14T06:24:29.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71352024-11-14T06:24:29.561ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71362024-11-14T06:24:29.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71372024-11-14T06:24:29.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71382024-11-14T06:24:29.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71392024-11-14T06:24:29.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71402024-11-14T06:24:29.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71412024-11-14T06:24:29.571ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
71422024-11-14T06:24:29.571ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 178.754017ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
71432024-11-14T06:24:29.572ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
71442024-11-14T06:24:29.572ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71452024-11-14T06:24:29.572ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
71462024-11-14T06:24:29.572ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffc0ce52-c794-494b-b4b2-6a51acd6b48b", "content-length": "26", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} })
71472024-11-14T06:24:29.572ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71482024-11-14T06:24:29.573ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
71492024-11-14T06:24:29.573ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 181.141151ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
71502024-11-14T06:24:29.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71512024-11-14T06:24:29.574ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
71522024-11-14T06:24:29.575ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
71532024-11-14T06:24:29.575ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71542024-11-14T06:24:29.576ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd44ecaa-a85f-4c34-b00d-4c0b3a679636", "content-length": "26", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} })
71552024-11-14T06:24:29.576ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71562024-11-14T06:24:29.577ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
71572024-11-14T06:24:29.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71582024-11-14T06:24:29.577ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71592024-11-14T06:24:29.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71602024-11-14T06:24:29.577ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71612024-11-14T06:24:29.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71622024-11-14T06:24:29.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71632024-11-14T06:24:29.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71642024-11-14T06:24:29.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71652024-11-14T06:24:29.596ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 203.492518ms iteration = 13 status = {"physical_disks_added":0}
71662024-11-14T06:24:29.625ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
71672024-11-14T06:24:29.625ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 232.822814ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
71682024-11-14T06:24:29.628ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
71692024-11-14T06:24:29.628ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
71702024-11-14T06:24:29.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71712024-11-14T06:24:29.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71722024-11-14T06:24:29.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71732024-11-14T06:24:29.631ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71742024-11-14T06:24:29.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71752024-11-14T06:24:29.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71762024-11-14T06:24:29.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71772024-11-14T06:24:29.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
71782024-11-14T06:24:29.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71792024-11-14T06:24:29.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71802024-11-14T06:24:29.646ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
71812024-11-14T06:24:29.646ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
71822024-11-14T06:24:29.646ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71832024-11-14T06:24:29.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71842024-11-14T06:24:29.832ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
71852024-11-14T06:24:29.856ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 463.718741ms iteration = 11 status = {}
71862024-11-14T06:24:29.859ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
71872024-11-14T06:24:29.860ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b4b0131f-c8fc-414b-897b-af648cd6c89f", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71882024-11-14T06:24:29.860ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71892024-11-14T06:24:29.861ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b37b825e-5755-4f57-997b-94af1ce2f772", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71902024-11-14T06:24:29.861ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71912024-11-14T06:24:29.863ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71922024-11-14T06:24:29.863ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 470.745422ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
71932024-11-14T06:24:29.872ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71942024-11-14T06:24:29.872ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8f672c4-83e8-4316-a281-1b09c8f42507", "content-length": "1", "date": "Thu, 14 Nov 2024 06:24:28 GMT"} })
71952024-11-14T06:24:29.874ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71962024-11-14T06:24:29.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71972024-11-14T06:24:29.880ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71982024-11-14T06:24:29.880ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71992024-11-14T06:24:29.880ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b855e38-6676-4b8c-a508-36106157d996", "content-length": "372", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} })
72002024-11-14T06:24:29.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72012024-11-14T06:24:29.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72022024-11-14T06:24:29.882ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
72032024-11-14T06:24:29.882ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
72042024-11-14T06:24:29.882ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
72052024-11-14T06:24:29.882ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 489.754726ms iteration = 7 status = {"generation":2}
72062024-11-14T06:24:29.967ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72072024-11-14T06:24:29.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72082024-11-14T06:24:29.971ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 578.327774ms iteration = 11 status = null
72092024-11-14T06:24:29.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72102024-11-14T06:24:29.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72112024-11-14T06:24:29.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72122024-11-14T06:24:29.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72132024-11-14T06:24:29.979ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
72142024-11-14T06:24:29.979ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
72152024-11-14T06:24:29.979ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
72162024-11-14T06:24:29.979ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 586.18515ms iteration = 7 status = {"generation":1}
72172024-11-14T06:24:29.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72182024-11-14T06:24:29.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72192024-11-14T06:24:29.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72202024-11-14T06:24:29.983ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72212024-11-14T06:24:29.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72222024-11-14T06:24:29.987ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72232024-11-14T06:24:29.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72242024-11-14T06:24:29.989ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
72252024-11-14T06:24:29.990ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d491ca19-a82a-4c10-85fe-900e710b4c1d", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72262024-11-14T06:24:29.990ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72272024-11-14T06:24:29.995ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "293f116e-1ded-4a4e-a71c-f8fcecede5ed", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72282024-11-14T06:24:29.995ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72292024-11-14T06:24:29.996ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "feb1442b-0618-4f04-ab1a-4d65339f5e6e", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72302024-11-14T06:24:29.996ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72312024-11-14T06:24:29.997ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72322024-11-14T06:24:29.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72332024-11-14T06:24:29.998ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72342024-11-14T06:24:29.998ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 606.00101ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
72352024-11-14T06:24:29.999ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72362024-11-14T06:24:29.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72372024-11-14T06:24:30.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72382024-11-14T06:24:30.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72392024-11-14T06:24:30.003ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72402024-11-14T06:24:30.007ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
72412024-11-14T06:24:30.007ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72422024-11-14T06:24:30.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72432024-11-14T06:24:30.008ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72442024-11-14T06:24:30.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72452024-11-14T06:24:30.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72462024-11-14T06:24:30.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72472024-11-14T06:24:30.012ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72482024-11-14T06:24:30.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72492024-11-14T06:24:30.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72502024-11-14T06:24:30.015ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
72512024-11-14T06:24:30.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72522024-11-14T06:24:30.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
72532024-11-14T06:24:30.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72542024-11-14T06:24:30.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72552024-11-14T06:24:30.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72562024-11-14T06:24:30.021ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
72572024-11-14T06:24:30.021ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72582024-11-14T06:24:30.025ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72592024-11-14T06:24:30.025ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd98a34b-1290-41ba-a6aa-2a0bb4e9de55", "content-length": "134", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} })
72602024-11-14T06:24:30.025ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72612024-11-14T06:24:30.025ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
72622024-11-14T06:24:30.026ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72632024-11-14T06:24:30.026ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72642024-11-14T06:24:30.026ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72652024-11-14T06:24:30.026ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72662024-11-14T06:24:30.026ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72672024-11-14T06:24:30.026ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72682024-11-14T06:24:30.026ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72692024-11-14T06:24:30.026ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72702024-11-14T06:24:30.026ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
72712024-11-14T06:24:30.026ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72722024-11-14T06:24:30.026ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
72732024-11-14T06:24:30.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72742024-11-14T06:24:30.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72752024-11-14T06:24:30.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72762024-11-14T06:24:30.028ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72772024-11-14T06:24:30.029ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72782024-11-14T06:24:30.029ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb22dc8d-f323-43bf-9ccd-6199eeb3c026", "content-length": "2", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} })
72792024-11-14T06:24:30.030ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72802024-11-14T06:24:30.030ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "67eb7f10-7ca1-4b0b-8050-d112bc7d6432", "content-length": "52", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} })
72812024-11-14T06:24:30.030ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
72822024-11-14T06:24:30.030ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72832024-11-14T06:24:30.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
72842024-11-14T06:24:30.030ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72852024-11-14T06:24:30.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72862024-11-14T06:24:30.032ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
72872024-11-14T06:24:30.032ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
72882024-11-14T06:24:30.032ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
72892024-11-14T06:24:30.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "752a2b71-f3dc-40e6-94ca-f2e2adeff688", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} })
72902024-11-14T06:24:30.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72912024-11-14T06:24:30.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72922024-11-14T06:24:30.073ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "04a6bca3-392d-4199-b041-e2a6858dd7c1", "content-length": "691", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} })
72932024-11-14T06:24:30.073ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
72942024-11-14T06:24:30.073ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
72952024-11-14T06:24:30.073ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
72962024-11-14T06:24:30.075ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 681.967793ms iteration = 11 status = {}
72972024-11-14T06:24:30.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72982024-11-14T06:24:30.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72992024-11-14T06:24:30.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73002024-11-14T06:24:30.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73012024-11-14T06:24:30.085ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73022024-11-14T06:24:30.085ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73032024-11-14T06:24:30.085ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6ad822dc-1b93-4ce1-9a66-5758a64113e6", "date": "Thu, 14 Nov 2024 06:24:30 GMT"} })
73042024-11-14T06:24:30.087ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 695.020067ms iteration = 12 status = {}
73052024-11-14T06:24:30.146ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, time_created: 2024-11-14T06:19:28.463914Z, time_modified: 2024-11-14T06:19:28.463914Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
73062024-11-14T06:24:30.146ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
73072024-11-14T06:24:30.146ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73082024-11-14T06:24:30.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73092024-11-14T06:24:30.149ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73102024-11-14T06:24:30.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73112024-11-14T06:24:30.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73122024-11-14T06:24:30.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
73132024-11-14T06:24:30.184ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
73142024-11-14T06:24:30.185ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "c526bd1b-f661-40f4-b1be-d386c73cb4e5", "date": "Thu, 14 Nov 2024 06:24:30 GMT"} })
73152024-11-14T06:24:30.185ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
73162024-11-14T06:24:30.185ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 793.057591ms
73172024-11-14T06:24:30.185ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 793.068741ms iteration = 2 status = {}
73182024-11-14T06:24:30.185ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "801016d0-916a-42d7-9b5e-4650bb51117e", "date": "Thu, 14 Nov 2024 06:24:30 GMT"} })
73192024-11-14T06:24:30.185ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
73202024-11-14T06:24:30.185ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73212024-11-14T06:24:30.190ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "528964e4-2373-472a-84b9-8d6fd465e579", "content-length": "682", "date": "Thu, 14 Nov 2024 06:24:29 GMT"} })
73222024-11-14T06:24:30.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73232024-11-14T06:24:30.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73242024-11-14T06:24:30.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73252024-11-14T06:24:30.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73262024-11-14T06:24:30.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73272024-11-14T06:24:30.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73282024-11-14T06:24:30.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73292024-11-14T06:24:30.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73302024-11-14T06:24:30.212ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 819.431352ms iteration = 11 status = {}
73312024-11-14T06:24:33.421ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
73322024-11-14T06:24:33.421ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
73332024-11-14T06:24:33.452ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
73342024-11-14T06:24:33.452ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:60667
73352024-11-14T06:24:33.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60667 req_id = 58a86ef2-e4ab-43dc-abfc-a5d125066295 roles = RoleSet { roles: {} } uri = /metrics/producers
73362024-11-14T06:24:33.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60667 req_id = 58a86ef2-e4ab-43dc-abfc-a5d125066295 resource = Database result = Ok(()) uri = /metrics/producers
73372024-11-14T06:24:33.488ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
73382024-11-14T06:24:33.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35765 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60667 req_id = 58a86ef2-e4ab-43dc-abfc-a5d125066295 response_code = 201 uri = /metrics/producers
73392024-11-14T06:24:33.488ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "58a86ef2-e4ab-43dc-abfc-a5d125066295", "content-length": "41", "date": "Thu, 14 Nov 2024 06:24:33 GMT"} })
73402024-11-14T06:24:33.489ZDEBGnexus (producer-registration-task): registered with nexus successfully
73412024-11-14T06:24:33.489ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
73422024-11-14T06:24:37.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1069 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = cd2a6a15-c347-4535-9dec-2675f72a005c response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
73432024-11-14T06:24:39.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
73442024-11-14T06:24:39.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
73452024-11-14T06:24:39.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73462024-11-14T06:24:39.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73472024-11-14T06:24:39.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73482024-11-14T06:24:39.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73492024-11-14T06:24:39.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73502024-11-14T06:24:39.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73512024-11-14T06:24:39.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73522024-11-14T06:24:39.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73532024-11-14T06:24:39.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73542024-11-14T06:24:39.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73552024-11-14T06:24:39.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.736359ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73562024-11-14T06:24:39.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73572024-11-14T06:24:39.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73582024-11-14T06:24:39.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73592024-11-14T06:24:39.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
73602024-11-14T06:24:39.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73612024-11-14T06:24:39.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73622024-11-14T06:24:39.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
73632024-11-14T06:24:39.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.624614ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
73642024-11-14T06:24:42.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 2671a901-3cdb-42b1-8bb4-c72c11bd4a03 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
73652024-11-14T06:24:42.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 2671a901-3cdb-42b1-8bb4-c72c11bd4a03 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
73662024-11-14T06:24:42.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 2671a901-3cdb-42b1-8bb4-c72c11bd4a03 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
73672024-11-14T06:24:42.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = c9b9c4e9-20eb-443c-b590-6251dcb14372 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
73682024-11-14T06:24:42.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = c9b9c4e9-20eb-443c-b590-6251dcb14372 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
73692024-11-14T06:24:42.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = c9b9c4e9-20eb-443c-b590-6251dcb14372 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
73702024-11-14T06:24:44.873ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:48969
73712024-11-14T06:24:44.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48969 req_id = 251a78a2-2045-4662-9ae3-a5f38390ed46 roles = RoleSet { roles: {} } uri = /metrics/producers
73722024-11-14T06:24:44.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48969 req_id = 251a78a2-2045-4662-9ae3-a5f38390ed46 resource = Database result = Ok(()) uri = /metrics/producers
73732024-11-14T06:24:44.945ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
73742024-11-14T06:24:44.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72128 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48969 req_id = 251a78a2-2045-4662-9ae3-a5f38390ed46 response_code = 201 uri = /metrics/producers
73752024-11-14T06:24:49.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
73762024-11-14T06:24:49.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
73772024-11-14T06:24:49.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73782024-11-14T06:24:49.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73792024-11-14T06:24:49.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73802024-11-14T06:24:49.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73812024-11-14T06:24:49.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73822024-11-14T06:24:49.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73832024-11-14T06:24:49.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73842024-11-14T06:24:49.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.686119ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73852024-11-14T06:24:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73862024-11-14T06:24:49.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73872024-11-14T06:24:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73882024-11-14T06:24:49.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73892024-11-14T06:24:49.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73902024-11-14T06:24:49.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73912024-11-14T06:24:49.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
73922024-11-14T06:24:49.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73932024-11-14T06:24:49.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73942024-11-14T06:24:49.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
73952024-11-14T06:24:49.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.819478ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
73962024-11-14T06:24:51.410ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41659
73972024-11-14T06:24:51.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41659 req_id = 74787a04-dea4-44cc-8cdc-789b170cc04e roles = RoleSet { roles: {} } uri = /metrics/producers
73982024-11-14T06:24:51.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41659 req_id = 74787a04-dea4-44cc-8cdc-789b170cc04e resource = Database result = Ok(()) uri = /metrics/producers
73992024-11-14T06:24:51.465ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 914339bb-5810-4f30-ae08-365f08250a83
74002024-11-14T06:24:51.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55343 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41659 req_id = 74787a04-dea4-44cc-8cdc-789b170cc04e response_code = 201 uri = /metrics/producers
74012024-11-14T06:24:52.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1228 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 1b2658cc-9b10-4b69-aae9-bc7924d31c28 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
74022024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
74032024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74042024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
74052024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
74062024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74072024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74082024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
74092024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74102024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
74112024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
74122024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74132024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
74142024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74152024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
74162024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74172024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74182024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74192024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
74202024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74212024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
74222024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
74232024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74242024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74252024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
74262024-11-14T06:24:59.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74272024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74282024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
74292024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74302024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
74312024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74322024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
74332024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74342024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
74352024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74362024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
74372024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74382024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74392024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74402024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74412024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74422024-11-14T06:24:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74432024-11-14T06:24:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74442024-11-14T06:24:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74452024-11-14T06:24:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74462024-11-14T06:24:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74472024-11-14T06:24:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74482024-11-14T06:24:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74492024-11-14T06:24:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74502024-11-14T06:24:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74512024-11-14T06:24:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74522024-11-14T06:24:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74532024-11-14T06:24:59.393ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.306773ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
74542024-11-14T06:24:59.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74552024-11-14T06:24:59.394ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.6305ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
74562024-11-14T06:24:59.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74572024-11-14T06:24:59.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74582024-11-14T06:24:59.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74592024-11-14T06:24:59.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74602024-11-14T06:24:59.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74612024-11-14T06:24:59.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
74622024-11-14T06:24:59.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74632024-11-14T06:24:59.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74642024-11-14T06:24:59.397ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74652024-11-14T06:24:59.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74662024-11-14T06:24:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74672024-11-14T06:24:59.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74682024-11-14T06:24:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74692024-11-14T06:24:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74702024-11-14T06:24:59.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74712024-11-14T06:24:59.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74722024-11-14T06:24:59.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74732024-11-14T06:24:59.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74742024-11-14T06:24:59.399ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74752024-11-14T06:24:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74762024-11-14T06:24:59.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74772024-11-14T06:24:59.401ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 958987858 } })
74782024-11-14T06:24:59.401ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
74792024-11-14T06:24:59.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
74802024-11-14T06:24:59.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74812024-11-14T06:24:59.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74822024-11-14T06:24:59.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
74832024-11-14T06:24:59.402ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74842024-11-14T06:24:59.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74852024-11-14T06:24:59.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.308238ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74862024-11-14T06:24:59.405ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74872024-11-14T06:24:59.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74882024-11-14T06:24:59.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 963408501 } })
74892024-11-14T06:24:59.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74902024-11-14T06:24:59.405ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
74912024-11-14T06:24:59.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 963891840 } })
74922024-11-14T06:24:59.406ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74932024-11-14T06:24:59.406ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74942024-11-14T06:24:59.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74952024-11-14T06:24:59.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
74962024-11-14T06:24:59.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74972024-11-14T06:24:59.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74982024-11-14T06:24:59.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74992024-11-14T06:24:59.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75002024-11-14T06:24:59.407ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75012024-11-14T06:24:59.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75022024-11-14T06:24:59.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75032024-11-14T06:24:59.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
75042024-11-14T06:24:59.412ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75052024-11-14T06:24:59.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75062024-11-14T06:24:59.425ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75072024-11-14T06:24:59.425ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 34.37706ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75082024-11-14T06:24:59.445ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
75092024-11-14T06:24:59.445ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.925514ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
75102024-11-14T06:24:59.452ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75112024-11-14T06:24:59.452ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75122024-11-14T06:24:59.452ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75132024-11-14T06:24:59.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75142024-11-14T06:24:59.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75152024-11-14T06:24:59.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75162024-11-14T06:24:59.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75172024-11-14T06:24:59.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75182024-11-14T06:24:59.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75192024-11-14T06:24:59.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.568231ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
75202024-11-14T06:24:59.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75212024-11-14T06:24:59.457ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75222024-11-14T06:24:59.458ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
75232024-11-14T06:24:59.458ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75242024-11-14T06:24:59.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75252024-11-14T06:24:59.459ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75262024-11-14T06:24:59.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75272024-11-14T06:24:59.461ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75282024-11-14T06:24:59.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75292024-11-14T06:24:59.462ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75302024-11-14T06:24:59.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75312024-11-14T06:24:59.495ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 104.437994ms iteration = 14 status = {"physical_disks_added":0}
75322024-11-14T06:24:59.525ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75332024-11-14T06:24:59.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75342024-11-14T06:24:59.543ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
75352024-11-14T06:24:59.543ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75362024-11-14T06:24:59.543ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12597371-14fe-4f93-b6ba-f5634d5eb07f", "content-length": "26", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
75372024-11-14T06:24:59.543ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75382024-11-14T06:24:59.546ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
75392024-11-14T06:24:59.566ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
75402024-11-14T06:24:59.566ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75412024-11-14T06:24:59.566ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "363cd220-8a2b-4bb1-83e9-7420d71e4fcb", "content-length": "372", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
75422024-11-14T06:24:59.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75432024-11-14T06:24:59.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75442024-11-14T06:24:59.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75452024-11-14T06:24:59.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75462024-11-14T06:24:59.573ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 181.129301ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
75472024-11-14T06:24:59.607ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
75482024-11-14T06:24:59.607ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75492024-11-14T06:24:59.608ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4210147-61ef-4936-ac6b-2e103136ae91", "content-length": "26", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
75502024-11-14T06:24:59.608ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75512024-11-14T06:24:59.613ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75522024-11-14T06:24:59.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75532024-11-14T06:24:59.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75542024-11-14T06:24:59.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
75552024-11-14T06:24:59.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75562024-11-14T06:24:59.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75572024-11-14T06:24:59.622ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75582024-11-14T06:24:59.622ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75592024-11-14T06:24:59.622ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
75602024-11-14T06:24:59.622ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 230.956788ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
75612024-11-14T06:24:59.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75622024-11-14T06:24:59.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75632024-11-14T06:24:59.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 235.903ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
75642024-11-14T06:24:59.629ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 237.754054ms iteration = 12 status = 0
75652024-11-14T06:24:59.631ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
75662024-11-14T06:24:59.631ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
75672024-11-14T06:24:59.631ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f49cfe2e-2840-41fd-98d6-0230e03f21f1", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
75682024-11-14T06:24:59.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75692024-11-14T06:24:59.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75702024-11-14T06:24:59.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 241.462544ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75712024-11-14T06:24:59.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75722024-11-14T06:24:59.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75732024-11-14T06:24:59.635ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
75742024-11-14T06:24:59.635ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75752024-11-14T06:24:59.635ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d7b87c7-ae84-4b2c-a411-40b9e734cb6a", "content-length": "26", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
75762024-11-14T06:24:59.635ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75772024-11-14T06:24:59.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75782024-11-14T06:24:59.638ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75792024-11-14T06:24:59.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75802024-11-14T06:24:59.643ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
75812024-11-14T06:24:59.643ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75822024-11-14T06:24:59.644ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b90d7953-6c7f-4089-b952-77683093264d", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
75832024-11-14T06:24:59.646ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 254.623469ms iteration = 13 status = {}
75842024-11-14T06:24:59.663ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75852024-11-14T06:24:59.666ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75862024-11-14T06:24:59.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75872024-11-14T06:24:59.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75882024-11-14T06:24:59.705ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
75892024-11-14T06:24:59.705ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e3ef4c3-0481-4f52-a7a1-83b0dbd523c0", "content-length": "1", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
75902024-11-14T06:24:59.707ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75912024-11-14T06:24:59.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75922024-11-14T06:24:59.710ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 319.039928ms iteration = 12 status = null
75932024-11-14T06:24:59.715ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 324.257945ms iteration = 12 status = {}
75942024-11-14T06:24:59.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75952024-11-14T06:24:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75962024-11-14T06:24:59.766ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
75972024-11-14T06:24:59.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75982024-11-14T06:24:59.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75992024-11-14T06:24:59.776ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
76002024-11-14T06:24:59.777ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e61cca5-1144-43d0-b792-8e79b9c853e5", "content-length": "134", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
76012024-11-14T06:24:59.777ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
76022024-11-14T06:24:59.777ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
76032024-11-14T06:24:59.777ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
76042024-11-14T06:24:59.777ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76052024-11-14T06:24:59.777ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76062024-11-14T06:24:59.777ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76072024-11-14T06:24:59.777ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76082024-11-14T06:24:59.777ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76092024-11-14T06:24:59.777ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76102024-11-14T06:24:59.777ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76112024-11-14T06:24:59.777ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
76122024-11-14T06:24:59.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76132024-11-14T06:24:59.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76142024-11-14T06:24:59.784ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76152024-11-14T06:24:59.786ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76162024-11-14T06:24:59.786ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e288f6c-08ed-4424-af38-b52f6f9ad5ec", "content-length": "2", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
76172024-11-14T06:24:59.786ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76182024-11-14T06:24:59.786ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdde4f4d-af5b-4668-bafd-ac589d9ea552", "content-length": "52", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
76192024-11-14T06:24:59.786ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
76202024-11-14T06:24:59.786ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76212024-11-14T06:24:59.860ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb5b69cb-e616-4f16-97d3-9a923ef2333d", "content-length": "691", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
76222024-11-14T06:24:59.860ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
76232024-11-14T06:24:59.860ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
76242024-11-14T06:24:59.860ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
76252024-11-14T06:24:59.862ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 471.452955ms iteration = 12 status = {}
76262024-11-14T06:24:59.952ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2f5b807c-ed8c-42b2-b806-8e5553a9e941", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
76272024-11-14T06:24:59.952ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
76282024-11-14T06:24:59.952ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76292024-11-14T06:24:59.952ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "431022b2-f228-4592-951f-cf8552d4a5a6", "content-length": "682", "date": "Thu, 14 Nov 2024 06:24:59 GMT"} })
76302024-11-14T06:24:59.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76312024-11-14T06:24:59.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76322024-11-14T06:24:59.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76332024-11-14T06:24:59.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76342024-11-14T06:24:59.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76352024-11-14T06:24:59.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76362024-11-14T06:24:59.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76372024-11-14T06:24:59.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76382024-11-14T06:24:59.970ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 579.088418ms iteration = 12 status = {}
76392024-11-14T06:25:07.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1361 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 03808417-0b6a-4f8a-aff4-dff02c5c2bf2 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
76402024-11-14T06:25:09.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
76412024-11-14T06:25:09.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76422024-11-14T06:25:09.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
76432024-11-14T06:25:09.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76442024-11-14T06:25:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76452024-11-14T06:25:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76462024-11-14T06:25:09.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76472024-11-14T06:25:09.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76482024-11-14T06:25:09.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76492024-11-14T06:25:09.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76502024-11-14T06:25:09.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76512024-11-14T06:25:09.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76522024-11-14T06:25:09.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76532024-11-14T06:25:09.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76542024-11-14T06:25:09.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76552024-11-14T06:25:09.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
76562024-11-14T06:25:09.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76572024-11-14T06:25:09.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76582024-11-14T06:25:09.442ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
76592024-11-14T06:25:09.442ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.111503ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
76602024-11-14T06:25:09.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.362429ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76612024-11-14T06:25:12.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 502dc8ce-71c3-43e2-b01c-d855c09fe540 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
76622024-11-14T06:25:12.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 502dc8ce-71c3-43e2-b01c-d855c09fe540 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
76632024-11-14T06:25:12.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 502dc8ce-71c3-43e2-b01c-d855c09fe540 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
76642024-11-14T06:25:12.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 54d2e0eb-ac0a-40b3-872b-331e991d9707 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
76652024-11-14T06:25:12.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 54d2e0eb-ac0a-40b3-872b-331e991d9707 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
76662024-11-14T06:25:12.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 54d2e0eb-ac0a-40b3-872b-331e991d9707 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
76672024-11-14T06:25:19.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
76682024-11-14T06:25:19.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
76692024-11-14T06:25:19.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76702024-11-14T06:25:19.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76712024-11-14T06:25:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76722024-11-14T06:25:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76732024-11-14T06:25:19.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76742024-11-14T06:25:19.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76752024-11-14T06:25:19.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76762024-11-14T06:25:19.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.107736ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76772024-11-14T06:25:19.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76782024-11-14T06:25:19.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76792024-11-14T06:25:19.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76802024-11-14T06:25:19.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76812024-11-14T06:25:19.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76822024-11-14T06:25:19.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76832024-11-14T06:25:19.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
76842024-11-14T06:25:19.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76852024-11-14T06:25:19.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76862024-11-14T06:25:19.416ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
76872024-11-14T06:25:19.416ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.254261ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
76882024-11-14T06:25:22.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1242 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 149ad22a-d631-4886-a221-6ea6e9f86fbc response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
76892024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
76902024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
76912024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76922024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76932024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76942024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
76952024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76962024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
76972024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
76982024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
76992024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
77002024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77012024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
77022024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77032024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
77042024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
77052024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77062024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
77072024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
77082024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
77092024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
77102024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
77112024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77122024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
77132024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
77142024-11-14T06:25:29.392ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:15:29.392318945 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
77152024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77162024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
77172024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
77182024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77192024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
77202024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
77212024-11-14T06:25:29.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
77222024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
77232024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77242024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77252024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
77262024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77272024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
77282024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77292024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
77302024-11-14T06:25:29.392ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
77312024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
77322024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77332024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
77342024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
77352024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
77362024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
77372024-11-14T06:25:29.392ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
77382024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
77392024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.39\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
77402024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
77412024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77422024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
77432024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
77442024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77452024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
77462024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77472024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
77482024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77492024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
77502024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
77512024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
77522024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77532024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77542024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77552024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77562024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77572024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77582024-11-14T06:25:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
77592024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77602024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77612024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77622024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77632024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77642024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77652024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77662024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
77672024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77682024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77692024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
77702024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77712024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
77722024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77732024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77742024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
77752024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77762024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
77772024-11-14T06:25:29.393ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 951211654 } })
77782024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77792024-11-14T06:25:29.393ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 951248434 } })
77802024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77812024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77822024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77832024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77842024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77852024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77862024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77872024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
77882024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.211392ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
77892024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
77902024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.386115ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
77912024-11-14T06:25:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77922024-11-14T06:25:29.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77932024-11-14T06:25:29.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77942024-11-14T06:25:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77952024-11-14T06:25:29.395ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 953976705 } })
77962024-11-14T06:25:29.396ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
77972024-11-14T06:25:29.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77982024-11-14T06:25:29.396ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77992024-11-14T06:25:29.396ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
78002024-11-14T06:25:29.396ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78012024-11-14T06:25:29.396ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.463833ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78022024-11-14T06:25:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78032024-11-14T06:25:29.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78042024-11-14T06:25:29.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78052024-11-14T06:25:29.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78062024-11-14T06:25:29.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
78072024-11-14T06:25:29.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78082024-11-14T06:25:29.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78092024-11-14T06:25:29.401ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78102024-11-14T06:25:29.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78112024-11-14T06:25:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78122024-11-14T06:25:29.401ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 959563129 } })
78132024-11-14T06:25:29.401ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
78142024-11-14T06:25:29.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78152024-11-14T06:25:29.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78162024-11-14T06:25:29.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78172024-11-14T06:25:29.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78182024-11-14T06:25:29.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78192024-11-14T06:25:29.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78202024-11-14T06:25:29.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78212024-11-14T06:25:29.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78222024-11-14T06:25:29.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78232024-11-14T06:25:29.404ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78242024-11-14T06:25:29.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78252024-11-14T06:25:29.405ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78262024-11-14T06:25:29.406ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:15:29.392318945 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
78272024-11-14T06:25:29.406ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.00983ms iteration = 7 status = {"expiration":"2024-11-14T06:15:29.392318945Z","pruned":[]}
78282024-11-14T06:25:29.406ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78292024-11-14T06:25:29.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
78302024-11-14T06:25:29.407ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78312024-11-14T06:25:29.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
78322024-11-14T06:25:29.408ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78332024-11-14T06:25:29.408ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78342024-11-14T06:25:29.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78352024-11-14T06:25:29.412ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.531734ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
78362024-11-14T06:25:29.412ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78372024-11-14T06:25:29.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
78382024-11-14T06:25:29.415ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78392024-11-14T06:25:29.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78402024-11-14T06:25:29.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78412024-11-14T06:25:29.423ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78422024-11-14T06:25:29.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78432024-11-14T06:25:29.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78442024-11-14T06:25:29.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78452024-11-14T06:25:29.426ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78462024-11-14T06:25:29.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78472024-11-14T06:25:29.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78482024-11-14T06:25:29.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78492024-11-14T06:25:29.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78502024-11-14T06:25:29.436ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 994645172 } })
78512024-11-14T06:25:29.437ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
78522024-11-14T06:25:29.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78532024-11-14T06:25:29.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78542024-11-14T06:25:29.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78552024-11-14T06:25:29.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78562024-11-14T06:25:29.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.138741ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
78572024-11-14T06:25:29.454ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78582024-11-14T06:25:29.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78592024-11-14T06:25:29.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78602024-11-14T06:25:29.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78612024-11-14T06:25:29.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78622024-11-14T06:25:29.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78632024-11-14T06:25:29.473ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
78642024-11-14T06:25:29.473ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
78652024-11-14T06:25:29.473ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 81.359785ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
78662024-11-14T06:25:29.475ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78672024-11-14T06:25:29.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78682024-11-14T06:25:29.478ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78692024-11-14T06:25:29.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78702024-11-14T06:25:29.480ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78712024-11-14T06:25:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78722024-11-14T06:25:29.483ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78732024-11-14T06:25:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78742024-11-14T06:25:29.484ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78752024-11-14T06:25:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78762024-11-14T06:25:29.487ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78772024-11-14T06:25:29.487ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78782024-11-14T06:25:29.488ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78792024-11-14T06:25:29.488ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78802024-11-14T06:25:29.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78812024-11-14T06:25:29.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78822024-11-14T06:25:29.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78832024-11-14T06:25:29.490ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78842024-11-14T06:25:29.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78852024-11-14T06:25:29.491ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78862024-11-14T06:25:29.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
78872024-11-14T06:25:29.491ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78882024-11-14T06:25:29.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78892024-11-14T06:25:29.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78902024-11-14T06:25:29.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78912024-11-14T06:25:29.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
78922024-11-14T06:25:29.493ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
78932024-11-14T06:25:29.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
78942024-11-14T06:25:29.495ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
78952024-11-14T06:25:29.495ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
78962024-11-14T06:25:29.495ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
78972024-11-14T06:25:29.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78982024-11-14T06:25:29.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78992024-11-14T06:25:29.496ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79002024-11-14T06:25:29.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79012024-11-14T06:25:29.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
79022024-11-14T06:25:29.499ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
79032024-11-14T06:25:29.499ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79042024-11-14T06:25:29.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79052024-11-14T06:25:29.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
79062024-11-14T06:25:29.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79072024-11-14T06:25:29.504ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 112.30709ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
79082024-11-14T06:25:29.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79092024-11-14T06:25:29.508ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 115.937178ms iteration = 4 status = {"nsuccess":5}
79102024-11-14T06:25:29.508ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
79112024-11-14T06:25:29.508ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
79122024-11-14T06:25:29.508ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
79132024-11-14T06:25:29.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79142024-11-14T06:25:29.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79152024-11-14T06:25:29.511ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
79162024-11-14T06:25:29.511ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
79172024-11-14T06:25:29.511ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 119.26625ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
79182024-11-14T06:25:29.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79192024-11-14T06:25:29.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79202024-11-14T06:25:29.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79212024-11-14T06:25:29.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79222024-11-14T06:25:29.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79232024-11-14T06:25:29.516ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
79242024-11-14T06:25:29.516ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
79252024-11-14T06:25:29.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79262024-11-14T06:25:29.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79272024-11-14T06:25:29.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79282024-11-14T06:25:29.519ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79292024-11-14T06:25:29.519ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79302024-11-14T06:25:29.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79312024-11-14T06:25:29.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79322024-11-14T06:25:29.521ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79332024-11-14T06:25:29.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79342024-11-14T06:25:29.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79352024-11-14T06:25:29.524ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79362024-11-14T06:25:29.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79372024-11-14T06:25:29.525ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
79382024-11-14T06:25:29.525ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 132.599688ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
79392024-11-14T06:25:29.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79402024-11-14T06:25:29.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
79412024-11-14T06:25:29.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79422024-11-14T06:25:29.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79432024-11-14T06:25:29.541ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
79442024-11-14T06:25:29.541ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
79452024-11-14T06:25:29.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79462024-11-14T06:25:29.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79472024-11-14T06:25:29.545ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 153.542868ms iteration = 13 status = 0
79482024-11-14T06:25:29.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 154.380374ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79492024-11-14T06:25:29.547ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
79502024-11-14T06:25:29.547ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
79512024-11-14T06:25:29.547ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
79522024-11-14T06:25:29.547ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 155.393832ms iteration = 8 status = {"generation":1}
79532024-11-14T06:25:29.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79542024-11-14T06:25:29.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
79552024-11-14T06:25:29.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
79562024-11-14T06:25:29.550ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 157.724115ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79572024-11-14T06:25:29.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
79582024-11-14T06:25:29.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79592024-11-14T06:25:29.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79602024-11-14T06:25:29.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 161.100798ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
79612024-11-14T06:25:29.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79622024-11-14T06:25:29.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79632024-11-14T06:25:29.559ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 166.808715ms iteration = 15 status = {"physical_disks_added":0}
79642024-11-14T06:25:29.560ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
79652024-11-14T06:25:29.567ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79662024-11-14T06:25:29.568ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79672024-11-14T06:25:29.568ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79682024-11-14T06:25:29.568ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 175.947465ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
79692024-11-14T06:25:29.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79702024-11-14T06:25:29.572ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79712024-11-14T06:25:29.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79722024-11-14T06:25:29.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79732024-11-14T06:25:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79742024-11-14T06:25:29.577ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
79752024-11-14T06:25:29.577ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 185.631635ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
79762024-11-14T06:25:29.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79772024-11-14T06:25:29.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79782024-11-14T06:25:29.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79792024-11-14T06:25:29.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79802024-11-14T06:25:29.589ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79812024-11-14T06:25:29.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79822024-11-14T06:25:29.591ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
79832024-11-14T06:25:29.591ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
79842024-11-14T06:25:29.591ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
79852024-11-14T06:25:29.591ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 199.542694ms iteration = 8 status = {"generation":2}
79862024-11-14T06:25:29.594ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
79872024-11-14T06:25:29.594ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79882024-11-14T06:25:29.595ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "06d39a4e-8d76-4b7d-a552-85c12756a6da", "content-length": "26", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} })
79892024-11-14T06:25:29.595ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79902024-11-14T06:25:29.597ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79912024-11-14T06:25:29.603ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
79922024-11-14T06:25:29.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 215.008582ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
79932024-11-14T06:25:29.611ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
79942024-11-14T06:25:29.611ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79952024-11-14T06:25:29.612ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "529f103b-e9f0-4e57-a42a-693ba5ca9f49", "content-length": "26", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} })
79962024-11-14T06:25:29.612ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79972024-11-14T06:25:29.614ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79982024-11-14T06:25:29.624ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
79992024-11-14T06:25:29.624ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 231.792904ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
80002024-11-14T06:25:29.689ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
80012024-11-14T06:25:29.689ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 296.784614ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
80022024-11-14T06:25:29.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80032024-11-14T06:25:29.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80042024-11-14T06:25:29.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80052024-11-14T06:25:29.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80062024-11-14T06:25:29.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80072024-11-14T06:25:29.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80082024-11-14T06:25:29.737ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80092024-11-14T06:25:29.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80102024-11-14T06:25:29.739ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80112024-11-14T06:25:29.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80122024-11-14T06:25:29.742ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
80132024-11-14T06:25:29.742ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80142024-11-14T06:25:29.742ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "987ab3f6-8dd6-4d2a-b702-f73904b1a5dc", "content-length": "26", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} })
80152024-11-14T06:25:29.742ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80162024-11-14T06:25:29.744ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
80172024-11-14T06:25:29.771ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
80182024-11-14T06:25:29.784ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 392.1818ms iteration = 13 status = {}
80192024-11-14T06:25:29.805ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80202024-11-14T06:25:29.805ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80212024-11-14T06:25:29.805ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "657b6b8c-b6b1-4f2b-b885-29301e7c0bab", "content-length": "372", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} })
80222024-11-14T06:25:29.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80232024-11-14T06:25:29.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80242024-11-14T06:25:29.809ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80252024-11-14T06:25:29.810ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fa8cc8d-504b-4df6-9093-f3c7ac96f6ab", "content-length": "1", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} })
80262024-11-14T06:25:29.811ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80272024-11-14T06:25:29.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80282024-11-14T06:25:29.814ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 421.875672ms iteration = 13 status = null
80292024-11-14T06:25:29.823ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
80302024-11-14T06:25:29.824ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5f60a220-ed27-4eba-bf72-bb4419f85679", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80312024-11-14T06:25:29.824ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80322024-11-14T06:25:29.826ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3f5bc28c-5bf1-43a2-adae-8cf35b9333db", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80332024-11-14T06:25:29.826ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80342024-11-14T06:25:29.827ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
80352024-11-14T06:25:29.827ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 435.413504ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
80362024-11-14T06:25:29.845ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34393
80372024-11-14T06:25:29.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34393 req_id = a0e7d087-88ee-4332-847c-20678b1e72e8 roles = RoleSet { roles: {} } uri = /metrics/producers
80382024-11-14T06:25:29.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34393 req_id = a0e7d087-88ee-4332-847c-20678b1e72e8 resource = Database result = Ok(()) uri = /metrics/producers
80392024-11-14T06:25:29.848ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
80402024-11-14T06:25:29.848ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ccbbf6ac-605a-4c02-bc00-08723e0e7008", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80412024-11-14T06:25:29.848ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80422024-11-14T06:25:29.850ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a6c4b70f-3ec6-4da0-929f-4ae1d5cc34ce", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80432024-11-14T06:25:29.850ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80442024-11-14T06:25:29.852ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ee9c6c56-31fa-4c0a-935d-7e7d2321eb5d", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80452024-11-14T06:25:29.852ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80462024-11-14T06:25:29.854ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80472024-11-14T06:25:29.854ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 462.383886ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
80482024-11-14T06:25:29.859ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
80492024-11-14T06:25:29.859ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80502024-11-14T06:25:29.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2c3ffa55-5b41-48ee-a9a4-f6bb5c05b139", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} })
80512024-11-14T06:25:29.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80522024-11-14T06:25:29.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80532024-11-14T06:25:29.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80542024-11-14T06:25:29.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80552024-11-14T06:25:29.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80562024-11-14T06:25:29.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80572024-11-14T06:25:29.868ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80582024-11-14T06:25:29.868ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80592024-11-14T06:25:29.868ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "50b97dd8-7a23-42df-8ab2-c8e7835175e0", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} })
80602024-11-14T06:25:29.870ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 478.362734ms iteration = 14 status = {}
80612024-11-14T06:25:29.903ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80622024-11-14T06:25:29.903ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f1c996c-8e9c-4f22-bdad-1c86259661d3", "content-length": "691", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} })
80632024-11-14T06:25:29.903ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
80642024-11-14T06:25:29.903ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
80652024-11-14T06:25:29.903ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
80662024-11-14T06:25:29.904ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 512.069271ms iteration = 13 status = {}
80672024-11-14T06:25:29.907ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 07d948d3-6a47-45eb-9ed3-629b45d23b8a
80682024-11-14T06:25:29.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62501 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34393 req_id = a0e7d087-88ee-4332-847c-20678b1e72e8 response_code = 201 uri = /metrics/producers
80692024-11-14T06:25:29.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80702024-11-14T06:25:29.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80712024-11-14T06:25:29.932ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
80722024-11-14T06:25:29.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80732024-11-14T06:25:29.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80742024-11-14T06:25:29.942ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80752024-11-14T06:25:29.943ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2b3758b-a376-4839-a7be-272d1d3d9f9e", "content-length": "134", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} })
80762024-11-14T06:25:29.943ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80772024-11-14T06:25:29.943ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
80782024-11-14T06:25:29.943ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80792024-11-14T06:25:29.943ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80802024-11-14T06:25:29.943ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80812024-11-14T06:25:29.943ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80822024-11-14T06:25:29.943ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80832024-11-14T06:25:29.943ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80842024-11-14T06:25:29.943ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80852024-11-14T06:25:29.943ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80862024-11-14T06:25:29.943ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
80872024-11-14T06:25:29.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80882024-11-14T06:25:29.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80892024-11-14T06:25:29.946ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
80902024-11-14T06:25:29.946ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "56b28623-ae8f-460f-b652-14ad7ea91a50", "content-length": "2", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} })
80912024-11-14T06:25:29.946ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
80922024-11-14T06:25:29.946ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "aeff41b8-7b32-4cea-964f-0d455e46fd76", "content-length": "52", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} })
80932024-11-14T06:25:29.946ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
80942024-11-14T06:25:29.946ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
80952024-11-14T06:25:30.055ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ea4b1b20-3204-4a1c-b218-2d4e4c6bc97c", "date": "Thu, 14 Nov 2024 06:25:29 GMT"} })
80962024-11-14T06:25:30.056ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
80972024-11-14T06:25:30.056ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80982024-11-14T06:25:30.056ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad2b7548-8eaa-4212-aa91-99a37216f41a", "content-length": "682", "date": "Thu, 14 Nov 2024 06:25:30 GMT"} })
80992024-11-14T06:25:30.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81002024-11-14T06:25:30.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81012024-11-14T06:25:30.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81022024-11-14T06:25:30.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81032024-11-14T06:25:30.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81042024-11-14T06:25:30.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81052024-11-14T06:25:30.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81062024-11-14T06:25:30.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81072024-11-14T06:25:30.074ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 681.882342ms iteration = 13 status = {}
81082024-11-14T06:25:37.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1099 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 23605ba1-2381-40ef-b25a-73bb2186b896 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
81092024-11-14T06:25:39.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
81102024-11-14T06:25:39.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
81112024-11-14T06:25:39.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81122024-11-14T06:25:39.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81132024-11-14T06:25:39.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81142024-11-14T06:25:39.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81152024-11-14T06:25:39.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81162024-11-14T06:25:39.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81172024-11-14T06:25:39.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81182024-11-14T06:25:39.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81192024-11-14T06:25:39.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81202024-11-14T06:25:39.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81212024-11-14T06:25:39.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81222024-11-14T06:25:39.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81232024-11-14T06:25:39.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81242024-11-14T06:25:39.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
81252024-11-14T06:25:39.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81262024-11-14T06:25:39.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81272024-11-14T06:25:39.411ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
81282024-11-14T06:25:39.411ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.815269ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
81292024-11-14T06:25:39.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.255312ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81302024-11-14T06:25:42.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 41cd7933-c0be-438a-8e64-a2f058373802 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
81312024-11-14T06:25:42.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 41cd7933-c0be-438a-8e64-a2f058373802 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
81322024-11-14T06:25:42.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 41cd7933-c0be-438a-8e64-a2f058373802 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
81332024-11-14T06:25:42.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 8eaca010-2d1e-4927-9c5a-7faeb94eb248 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
81342024-11-14T06:25:42.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 8eaca010-2d1e-4927-9c5a-7faeb94eb248 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
81352024-11-14T06:25:42.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 8eaca010-2d1e-4927-9c5a-7faeb94eb248 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
81362024-11-14T06:25:49.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
81372024-11-14T06:25:49.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81382024-11-14T06:25:49.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
81392024-11-14T06:25:49.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81402024-11-14T06:25:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81412024-11-14T06:25:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81422024-11-14T06:25:49.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81432024-11-14T06:25:49.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81442024-11-14T06:25:49.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81452024-11-14T06:25:49.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81462024-11-14T06:25:49.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81472024-11-14T06:25:49.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81482024-11-14T06:25:49.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81492024-11-14T06:25:49.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
81502024-11-14T06:25:49.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81512024-11-14T06:25:49.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81522024-11-14T06:25:49.413ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
81532024-11-14T06:25:49.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.791016ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
81542024-11-14T06:25:49.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81552024-11-14T06:25:49.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81562024-11-14T06:25:49.452ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.671659ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81572024-11-14T06:25:52.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1232 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 24d76884-c64f-4e69-87be-b1e223545eec response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
81582024-11-14T06:25:53.293ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35195
81592024-11-14T06:25:53.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35195 req_id = 6a8d61ad-156a-416b-96ab-ec0643ea5fbd roles = RoleSet { roles: {} } uri = /metrics/producers
81602024-11-14T06:25:53.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35195 req_id = 6a8d61ad-156a-416b-96ab-ec0643ea5fbd resource = Database result = Ok(()) uri = /metrics/producers
81612024-11-14T06:25:53.304ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6826e3df-ce47-4da7-be1a-7b4ea7b6cca4
81622024-11-14T06:25:53.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11684 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35195 req_id = 6a8d61ad-156a-416b-96ab-ec0643ea5fbd response_code = 201 uri = /metrics/producers
81632024-11-14T06:25:59.315ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52533
81642024-11-14T06:25:59.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52533 req_id = 5c1485cf-8271-4084-842d-956e06cec577 roles = RoleSet { roles: {} } uri = /metrics/producers
81652024-11-14T06:25:59.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52533 req_id = 5c1485cf-8271-4084-842d-956e06cec577 resource = Database result = Ok(()) uri = /metrics/producers
81662024-11-14T06:25:59.362ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6cb81177-384c-420e-b49a-7c6450fab666
81672024-11-14T06:25:59.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47319 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52533 req_id = 5c1485cf-8271-4084-842d-956e06cec577 response_code = 201 uri = /metrics/producers
81682024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
81692024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
81702024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81712024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81722024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
81732024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
81742024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
81752024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
81762024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81772024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
81782024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81792024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81802024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
81812024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81822024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
81832024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
81842024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81852024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
81862024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
81872024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81882024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81892024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
81902024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
81912024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81922024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81932024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
81942024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
81952024-11-14T06:25:59.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
81962024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
81972024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81982024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
81992024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82002024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
82012024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
82022024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82032024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82042024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
82052024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82062024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82072024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82082024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82092024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82102024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82112024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82122024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82132024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82142024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82152024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82162024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82172024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
82182024-11-14T06:25:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
82192024-11-14T06:25:59.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.841861ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
82202024-11-14T06:25:59.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82212024-11-14T06:25:59.397ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82222024-11-14T06:25:59.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82232024-11-14T06:25:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82242024-11-14T06:25:59.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82252024-11-14T06:25:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
82262024-11-14T06:25:59.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82272024-11-14T06:25:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82282024-11-14T06:25:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82292024-11-14T06:25:59.399ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82302024-11-14T06:25:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82312024-11-14T06:25:59.399ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 957910268 } })
82322024-11-14T06:25:59.400ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
82332024-11-14T06:25:59.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
82342024-11-14T06:25:59.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82352024-11-14T06:25:59.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82362024-11-14T06:25:59.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 964013282 } })
82372024-11-14T06:25:59.409ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
82382024-11-14T06:25:59.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 19.195827ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
82392024-11-14T06:25:59.413ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82402024-11-14T06:25:59.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82412024-11-14T06:25:59.414ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 972856047 } })
82422024-11-14T06:25:59.415ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82432024-11-14T06:25:59.415ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
82442024-11-14T06:25:59.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82452024-11-14T06:25:59.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82462024-11-14T06:25:59.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82472024-11-14T06:25:59.418ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82482024-11-14T06:25:59.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82492024-11-14T06:25:59.433ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82502024-11-14T06:25:59.433ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
82512024-11-14T06:25:59.433ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82522024-11-14T06:25:59.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82532024-11-14T06:25:59.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82542024-11-14T06:25:59.448ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82552024-11-14T06:25:59.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82562024-11-14T06:25:59.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82572024-11-14T06:25:59.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.588972ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
82582024-11-14T06:25:59.449ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82592024-11-14T06:25:59.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82602024-11-14T06:25:59.453ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82612024-11-14T06:25:59.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82622024-11-14T06:25:59.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.810065ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82632024-11-14T06:25:59.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.857533ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
82642024-11-14T06:25:59.460ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82652024-11-14T06:25:59.460ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82662024-11-14T06:25:59.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82672024-11-14T06:25:59.462ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82682024-11-14T06:25:59.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82692024-11-14T06:25:59.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
82702024-11-14T06:25:59.463ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82712024-11-14T06:25:59.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82722024-11-14T06:25:59.464ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82732024-11-14T06:25:59.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82742024-11-14T06:25:59.465ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82752024-11-14T06:25:59.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82762024-11-14T06:25:59.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82772024-11-14T06:25:59.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82782024-11-14T06:25:59.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
82792024-11-14T06:25:59.470ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82802024-11-14T06:25:59.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82812024-11-14T06:25:59.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82822024-11-14T06:25:59.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82832024-11-14T06:25:59.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82842024-11-14T06:25:59.473ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 81.892024ms iteration = 14 status = 0
82852024-11-14T06:25:59.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82862024-11-14T06:25:59.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
82872024-11-14T06:25:59.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82882024-11-14T06:25:59.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82892024-11-14T06:25:59.487ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82902024-11-14T06:25:59.487ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82912024-11-14T06:25:59.487ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82922024-11-14T06:25:59.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82932024-11-14T06:25:59.494ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
82942024-11-14T06:25:59.494ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.848025ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
82952024-11-14T06:25:59.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82962024-11-14T06:25:59.498ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82972024-11-14T06:25:59.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82982024-11-14T06:25:59.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82992024-11-14T06:25:59.512ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83002024-11-14T06:25:59.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83012024-11-14T06:25:59.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 121.515641ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83022024-11-14T06:25:59.517ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
83032024-11-14T06:25:59.517ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 126.561466ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
83042024-11-14T06:25:59.536ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
83052024-11-14T06:25:59.536ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83062024-11-14T06:25:59.537ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aceaf8b4-ca2d-4ec0-87a9-7fa9c0083a05", "content-length": "26", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83072024-11-14T06:25:59.537ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83082024-11-14T06:25:59.539ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
83092024-11-14T06:25:59.539ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83102024-11-14T06:25:59.539ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
83112024-11-14T06:25:59.539ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.152088ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
83122024-11-14T06:25:59.547ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83132024-11-14T06:25:59.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83142024-11-14T06:25:59.550ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.03714ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
83152024-11-14T06:25:59.557ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 166.664212ms iteration = 16 status = {"physical_disks_added":0}
83162024-11-14T06:25:59.604ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
83172024-11-14T06:25:59.604ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83182024-11-14T06:25:59.605ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3d1de8b-e6ca-4b2f-90c4-f5d1ad610bb3", "content-length": "26", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83192024-11-14T06:25:59.605ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83202024-11-14T06:25:59.606ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83212024-11-14T06:25:59.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
83222024-11-14T06:25:59.619ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83232024-11-14T06:25:59.620ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b944d645-b41c-44a2-9c56-457befadc14c", "content-length": "26", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83242024-11-14T06:25:59.620ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83252024-11-14T06:25:59.624ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83262024-11-14T06:25:59.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83272024-11-14T06:25:59.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83282024-11-14T06:25:59.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83292024-11-14T06:25:59.687ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83302024-11-14T06:25:59.687ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83312024-11-14T06:25:59.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83322024-11-14T06:25:59.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83332024-11-14T06:25:59.691ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83342024-11-14T06:25:59.691ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83352024-11-14T06:25:59.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83362024-11-14T06:25:59.697ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
83372024-11-14T06:25:59.697ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83382024-11-14T06:25:59.698ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2cd08cf-717f-4033-a864-a2e345ed1a24", "content-length": "372", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83392024-11-14T06:25:59.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83402024-11-14T06:25:59.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83412024-11-14T06:25:59.713ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
83422024-11-14T06:25:59.713ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83432024-11-14T06:25:59.714ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7b4e663e-85c8-4a63-a76e-8e0bbfa6aee1", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83442024-11-14T06:25:59.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83452024-11-14T06:25:59.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83462024-11-14T06:25:59.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83472024-11-14T06:25:59.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83482024-11-14T06:25:59.719ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 328.045525ms iteration = 14 status = {}
83492024-11-14T06:25:59.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83502024-11-14T06:25:59.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83512024-11-14T06:25:59.725ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
83522024-11-14T06:25:59.725ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83532024-11-14T06:25:59.726ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c61c5e29-fc5e-4bbf-b312-6d476de5ad49", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83542024-11-14T06:25:59.727ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 336.157367ms iteration = 15 status = {}
83552024-11-14T06:25:59.727ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
83562024-11-14T06:25:59.727ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd16912c-08de-463a-947a-5742cd979dd0", "content-length": "1", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83572024-11-14T06:25:59.728ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83582024-11-14T06:25:59.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83592024-11-14T06:25:59.731ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 339.827455ms iteration = 14 status = null
83602024-11-14T06:25:59.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83612024-11-14T06:25:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83622024-11-14T06:25:59.764ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
83632024-11-14T06:25:59.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83642024-11-14T06:25:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83652024-11-14T06:25:59.772ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
83662024-11-14T06:25:59.772ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "52fb0dd4-5809-43e7-84c3-b69a9192b739", "content-length": "134", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83672024-11-14T06:25:59.772ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
83682024-11-14T06:25:59.772ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
83692024-11-14T06:25:59.773ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
83702024-11-14T06:25:59.773ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
83712024-11-14T06:25:59.773ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83722024-11-14T06:25:59.773ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83732024-11-14T06:25:59.773ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83742024-11-14T06:25:59.773ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83752024-11-14T06:25:59.773ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83762024-11-14T06:25:59.773ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83772024-11-14T06:25:59.773ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
83782024-11-14T06:25:59.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83792024-11-14T06:25:59.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83802024-11-14T06:25:59.775ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
83812024-11-14T06:25:59.775ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1491ae66-7af3-4ff6-992e-d59e84f6bd2d", "content-length": "2", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83822024-11-14T06:25:59.775ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
83832024-11-14T06:25:59.775ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "055b780a-5515-4f1d-80dc-f9809be36dd5", "content-length": "52", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83842024-11-14T06:25:59.775ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
83852024-11-14T06:25:59.775ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
83862024-11-14T06:25:59.797ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
83872024-11-14T06:25:59.866ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef9efb7f-b6ab-49ff-a340-0d7eeac57d73", "content-length": "691", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83882024-11-14T06:25:59.866ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
83892024-11-14T06:25:59.866ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
83902024-11-14T06:25:59.866ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
83912024-11-14T06:25:59.868ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 477.418946ms iteration = 14 status = {}
83922024-11-14T06:25:59.971ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a46b5b0f-3c94-4cee-ba21-0de3316ab523", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83932024-11-14T06:25:59.971ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
83942024-11-14T06:25:59.971ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
83952024-11-14T06:25:59.975ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b91ad5e-394d-4c68-893f-d941c841e169", "content-length": "682", "date": "Thu, 14 Nov 2024 06:25:59 GMT"} })
83962024-11-14T06:25:59.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83972024-11-14T06:25:59.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83982024-11-14T06:25:59.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83992024-11-14T06:25:59.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84002024-11-14T06:25:59.981ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84012024-11-14T06:25:59.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84022024-11-14T06:25:59.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84032024-11-14T06:25:59.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84042024-11-14T06:25:59.991ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 600.392675ms iteration = 14 status = {}
84052024-11-14T06:26:07.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1219 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 5ded9f28-fcdb-4b0b-ac2f-fb0ef5a6550a response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
84062024-11-14T06:26:09.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
84072024-11-14T06:26:09.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84082024-11-14T06:26:09.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
84092024-11-14T06:26:09.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84102024-11-14T06:26:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84112024-11-14T06:26:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84122024-11-14T06:26:09.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84132024-11-14T06:26:09.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84142024-11-14T06:26:09.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84152024-11-14T06:26:09.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.066535ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84162024-11-14T06:26:09.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84172024-11-14T06:26:09.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84182024-11-14T06:26:09.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84192024-11-14T06:26:09.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84202024-11-14T06:26:09.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84212024-11-14T06:26:09.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84222024-11-14T06:26:09.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
84232024-11-14T06:26:09.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84242024-11-14T06:26:09.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84252024-11-14T06:26:09.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
84262024-11-14T06:26:09.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.469971ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
84272024-11-14T06:26:19.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
84282024-11-14T06:26:19.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
84292024-11-14T06:26:19.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84302024-11-14T06:26:19.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84312024-11-14T06:26:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84322024-11-14T06:26:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84332024-11-14T06:26:19.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84342024-11-14T06:26:19.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84352024-11-14T06:26:19.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84362024-11-14T06:26:19.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.050475ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84372024-11-14T06:26:19.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84382024-11-14T06:26:19.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84392024-11-14T06:26:19.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84402024-11-14T06:26:19.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84412024-11-14T06:26:19.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84422024-11-14T06:26:19.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84432024-11-14T06:26:19.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
84442024-11-14T06:26:19.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84452024-11-14T06:26:19.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84462024-11-14T06:26:19.413ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
84472024-11-14T06:26:19.414ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.290905ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
84482024-11-14T06:26:22.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1235 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 980e6967-43b1-4fd7-ba69-dc9c8b610b41 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
84492024-11-14T06:26:27.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = b183e285-0622-4ed3-bbc0-7e243d8a6946 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
84502024-11-14T06:26:27.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = b183e285-0622-4ed3-bbc0-7e243d8a6946 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
84512024-11-14T06:26:27.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = b183e285-0622-4ed3-bbc0-7e243d8a6946 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
84522024-11-14T06:26:27.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 298faa7c-6df1-4ef4-bc63-401341499973 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
84532024-11-14T06:26:27.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 298faa7c-6df1-4ef4-bc63-401341499973 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
84542024-11-14T06:26:27.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 298faa7c-6df1-4ef4-bc63-401341499973 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
84552024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
84562024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84572024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
84582024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84592024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
84602024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
84612024-11-14T06:26:29.391ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
84622024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84632024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
84642024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84652024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
84662024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84672024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
84682024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84692024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
84702024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
84712024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
84722024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
84732024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84742024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
84752024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84762024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84772024-11-14T06:26:29.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
84782024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
84792024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
84802024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84812024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
84822024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84832024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84842024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
84852024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
84862024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84872024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
84882024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84892024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
84902024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84912024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
84922024-11-14T06:26:29.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84932024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
84942024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
84952024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84962024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
84972024-11-14T06:26:29.392ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
84982024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.68\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
84992024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
85002024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
85012024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85022024-11-14T06:26:29.392ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:16:29.392026960 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
85032024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
85042024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
85052024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
85062024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85072024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
85082024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
85092024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
85102024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
85112024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
85122024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85132024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
85142024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
85152024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
85162024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85172024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85182024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85192024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
85202024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85212024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85222024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
85232024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85242024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85252024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85262024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85272024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
85282024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85292024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85302024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85312024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85322024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
85332024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85342024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
85352024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
85362024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85372024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85382024-11-14T06:26:29.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 950749585 } })
85392024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85402024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85412024-11-14T06:26:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85422024-11-14T06:26:29.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 950880167 } })
85432024-11-14T06:26:29.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
85442024-11-14T06:26:29.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.310804ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
85452024-11-14T06:26:29.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
85462024-11-14T06:26:29.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.150322ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
85472024-11-14T06:26:29.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85482024-11-14T06:26:29.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85492024-11-14T06:26:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85502024-11-14T06:26:29.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.451134ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85512024-11-14T06:26:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85522024-11-14T06:26:29.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85532024-11-14T06:26:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85542024-11-14T06:26:29.397ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85552024-11-14T06:26:29.397ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85562024-11-14T06:26:29.397ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85572024-11-14T06:26:29.397ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85582024-11-14T06:26:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85592024-11-14T06:26:29.397ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85602024-11-14T06:26:29.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85612024-11-14T06:26:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
85622024-11-14T06:26:29.400ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
85632024-11-14T06:26:29.400ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85642024-11-14T06:26:29.400ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85652024-11-14T06:26:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
85662024-11-14T06:26:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85672024-11-14T06:26:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85682024-11-14T06:26:29.401ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85692024-11-14T06:26:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85702024-11-14T06:26:29.402ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 960548207 } })
85712024-11-14T06:26:29.402ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
85722024-11-14T06:26:29.403ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 961453934 } })
85732024-11-14T06:26:29.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
85742024-11-14T06:26:29.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85752024-11-14T06:26:29.404ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85762024-11-14T06:26:29.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85772024-11-14T06:26:29.405ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
85782024-11-14T06:26:29.405ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:16:29.392026960 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
85792024-11-14T06:26:29.405ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.637014ms iteration = 8 status = {"expiration":"2024-11-14T06:16:29.392026960Z","pruned":[]}
85802024-11-14T06:26:29.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
85812024-11-14T06:26:29.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85822024-11-14T06:26:29.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85832024-11-14T06:26:29.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85842024-11-14T06:26:29.406ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.532511ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
85852024-11-14T06:26:29.406ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85862024-11-14T06:26:29.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85872024-11-14T06:26:29.408ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85882024-11-14T06:26:29.408ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.313624ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
85892024-11-14T06:26:29.409ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85902024-11-14T06:26:29.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85912024-11-14T06:26:29.411ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85922024-11-14T06:26:29.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85932024-11-14T06:26:29.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85942024-11-14T06:26:29.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85952024-11-14T06:26:29.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85962024-11-14T06:26:29.414ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 972541880 } })
85972024-11-14T06:26:29.414ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
85982024-11-14T06:26:29.415ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85992024-11-14T06:26:29.415ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
86002024-11-14T06:26:29.415ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86012024-11-14T06:26:29.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86022024-11-14T06:26:29.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86032024-11-14T06:26:29.416ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86042024-11-14T06:26:29.417ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86052024-11-14T06:26:29.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86062024-11-14T06:26:29.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86072024-11-14T06:26:29.419ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
86082024-11-14T06:26:29.419ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 27.170465ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
86092024-11-14T06:26:29.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86102024-11-14T06:26:29.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86112024-11-14T06:26:29.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86122024-11-14T06:26:29.422ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86132024-11-14T06:26:29.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86142024-11-14T06:26:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86152024-11-14T06:26:29.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86162024-11-14T06:26:29.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86172024-11-14T06:26:29.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86182024-11-14T06:26:29.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86192024-11-14T06:26:29.439ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86202024-11-14T06:26:29.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86212024-11-14T06:26:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86222024-11-14T06:26:29.441ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86232024-11-14T06:26:29.441ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.640854ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86242024-11-14T06:26:29.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
86252024-11-14T06:26:29.442ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86262024-11-14T06:26:29.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86272024-11-14T06:26:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
86282024-11-14T06:26:29.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86292024-11-14T06:26:29.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86302024-11-14T06:26:29.447ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86312024-11-14T06:26:29.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86322024-11-14T06:26:29.454ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86332024-11-14T06:26:29.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.39966ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
86342024-11-14T06:26:29.455ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
86352024-11-14T06:26:29.455ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
86362024-11-14T06:26:29.455ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.551013ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
86372024-11-14T06:26:29.457ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
86382024-11-14T06:26:29.457ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86392024-11-14T06:26:29.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86402024-11-14T06:26:29.462ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86412024-11-14T06:26:29.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86422024-11-14T06:26:29.470ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.527862ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86432024-11-14T06:26:29.475ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
86442024-11-14T06:26:29.475ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
86452024-11-14T06:26:29.475ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
86462024-11-14T06:26:29.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86472024-11-14T06:26:29.475ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86482024-11-14T06:26:29.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86492024-11-14T06:26:29.477ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
86502024-11-14T06:26:29.477ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.132355ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
86512024-11-14T06:26:29.477ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86522024-11-14T06:26:29.478ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86532024-11-14T06:26:29.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86542024-11-14T06:26:29.478ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86552024-11-14T06:26:29.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86562024-11-14T06:26:29.478ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86572024-11-14T06:26:29.478ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.213123ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86582024-11-14T06:26:29.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86592024-11-14T06:26:29.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86602024-11-14T06:26:29.480ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.680821ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
86612024-11-14T06:26:29.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86622024-11-14T06:26:29.482ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86632024-11-14T06:26:29.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86642024-11-14T06:26:29.484ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86652024-11-14T06:26:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86662024-11-14T06:26:29.485ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86672024-11-14T06:26:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86682024-11-14T06:26:29.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86692024-11-14T06:26:29.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86702024-11-14T06:26:29.487ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
86712024-11-14T06:26:29.487ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
86722024-11-14T06:26:29.487ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
86732024-11-14T06:26:29.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86742024-11-14T06:26:29.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86752024-11-14T06:26:29.488ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
86762024-11-14T06:26:29.488ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
86772024-11-14T06:26:29.488ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 96.363354ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
86782024-11-14T06:26:29.489ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86792024-11-14T06:26:29.489ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86802024-11-14T06:26:29.489ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 97.608587ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86812024-11-14T06:26:29.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86822024-11-14T06:26:29.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
86832024-11-14T06:26:29.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86842024-11-14T06:26:29.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86852024-11-14T06:26:29.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86862024-11-14T06:26:29.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86872024-11-14T06:26:29.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86882024-11-14T06:26:29.493ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.51674ms iteration = 15 status = 0
86892024-11-14T06:26:29.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86902024-11-14T06:26:29.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86912024-11-14T06:26:29.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86922024-11-14T06:26:29.496ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
86932024-11-14T06:26:29.496ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
86942024-11-14T06:26:29.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86952024-11-14T06:26:29.496ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86962024-11-14T06:26:29.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86972024-11-14T06:26:29.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86982024-11-14T06:26:29.506ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
86992024-11-14T06:26:29.506ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 114.695285ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
87002024-11-14T06:26:29.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 149.196207ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
87012024-11-14T06:26:29.541ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
87022024-11-14T06:26:29.541ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
87032024-11-14T06:26:29.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87042024-11-14T06:26:29.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87052024-11-14T06:26:29.542ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 150.274007ms iteration = 17 status = {"physical_disks_added":0}
87062024-11-14T06:26:29.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87072024-11-14T06:26:29.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
87082024-11-14T06:26:29.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87092024-11-14T06:26:29.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87102024-11-14T06:26:29.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87112024-11-14T06:26:29.548ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
87122024-11-14T06:26:29.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87132024-11-14T06:26:29.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87142024-11-14T06:26:29.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87152024-11-14T06:26:29.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87162024-11-14T06:26:29.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87172024-11-14T06:26:29.593ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
87182024-11-14T06:26:29.593ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87192024-11-14T06:26:29.593ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dafa2fd5-bf02-40c6-abce-e695eeba87fe", "content-length": "26", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} })
87202024-11-14T06:26:29.593ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87212024-11-14T06:26:29.595ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
87222024-11-14T06:26:29.598ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
87232024-11-14T06:26:29.598ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87242024-11-14T06:26:29.598ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fb914a2-0891-4f0c-9851-e188ba836b6f", "content-length": "26", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} })
87252024-11-14T06:26:29.598ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87262024-11-14T06:26:29.605ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87272024-11-14T06:26:29.654ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
87282024-11-14T06:26:29.718ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
87292024-11-14T06:26:29.718ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87302024-11-14T06:26:29.719ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "af4bda45-7ab5-4f7e-9c29-3201a382ad08", "content-length": "372", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} })
87312024-11-14T06:26:29.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87322024-11-14T06:26:29.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87332024-11-14T06:26:29.721ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
87342024-11-14T06:26:29.721ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
87352024-11-14T06:26:29.721ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
87362024-11-14T06:26:29.721ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 328.961352ms iteration = 9 status = {"generation":2}
87372024-11-14T06:26:29.722ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
87382024-11-14T06:26:29.722ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
87392024-11-14T06:26:29.722ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
87402024-11-14T06:26:29.722ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 330.005432ms iteration = 9 status = {"generation":1}
87412024-11-14T06:26:29.745ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
87422024-11-14T06:26:29.759ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
87432024-11-14T06:26:29.759ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87442024-11-14T06:26:29.759ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c04ca4c4-3b3b-43a9-956e-489316b42b24", "content-length": "26", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} })
87452024-11-14T06:26:29.759ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87462024-11-14T06:26:29.761ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87472024-11-14T06:26:29.771ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
87482024-11-14T06:26:29.771ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87492024-11-14T06:26:29.771ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "01664559-ae15-4400-a344-c14c4b69e439", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} })
87502024-11-14T06:26:29.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87512024-11-14T06:26:29.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87522024-11-14T06:26:29.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87532024-11-14T06:26:29.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87542024-11-14T06:26:29.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87552024-11-14T06:26:29.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87562024-11-14T06:26:29.782ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87572024-11-14T06:26:29.782ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87582024-11-14T06:26:29.782ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "775ab34c-9548-4543-a5a9-7cd36568edce", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} })
87592024-11-14T06:26:29.783ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 391.890384ms iteration = 16 status = {}
87602024-11-14T06:26:29.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87612024-11-14T06:26:29.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87622024-11-14T06:26:29.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87632024-11-14T06:26:29.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87642024-11-14T06:26:29.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87652024-11-14T06:26:29.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87662024-11-14T06:26:29.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87672024-11-14T06:26:29.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87682024-11-14T06:26:29.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87692024-11-14T06:26:29.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87702024-11-14T06:26:29.868ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
87712024-11-14T06:26:29.868ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "12fd0068-e4b1-4fd4-a6db-fcbf284e0fc0", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87722024-11-14T06:26:29.868ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87732024-11-14T06:26:29.870ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "74d07cdc-e6df-4b88-9c70-47d09f3f21eb", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87742024-11-14T06:26:29.870ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87752024-11-14T06:26:29.871ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87762024-11-14T06:26:29.871ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 480.073826ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
87772024-11-14T06:26:29.900ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
87782024-11-14T06:26:29.901ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "27b4e5f7-138b-4adf-a35c-8f22006a001c", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87792024-11-14T06:26:29.901ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87802024-11-14T06:26:29.903ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c178fa37-94d8-438b-ac58-57a47c04d20a", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87812024-11-14T06:26:29.903ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87822024-11-14T06:26:29.905ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b7d42ca6-5d8f-4252-a7eb-4ba2d4062e3a", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87832024-11-14T06:26:29.905ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87842024-11-14T06:26:29.907ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
87852024-11-14T06:26:29.907ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 515.936423ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
87862024-11-14T06:26:29.957ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
87872024-11-14T06:26:29.958ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac5e06ac-66a8-4c7c-bb68-ee4ee077d314", "content-length": "1", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} })
87882024-11-14T06:26:29.959ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87892024-11-14T06:26:29.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87902024-11-14T06:26:29.962ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 570.5349ms iteration = 15 status = null
87912024-11-14T06:26:29.981ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87922024-11-14T06:26:30.034ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "41eb2d6a-6a27-46c2-bc39-14b1269e0198", "content-length": "691", "date": "Thu, 14 Nov 2024 06:26:30 GMT"} })
87932024-11-14T06:26:30.034ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
87942024-11-14T06:26:30.034ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
87952024-11-14T06:26:30.034ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
87962024-11-14T06:26:30.036ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 644.74031ms iteration = 15 status = {}
87972024-11-14T06:26:30.036ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 644.861273ms iteration = 15 status = {}
87982024-11-14T06:26:30.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87992024-11-14T06:26:30.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88002024-11-14T06:26:30.074ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
88012024-11-14T06:26:30.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88022024-11-14T06:26:30.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88032024-11-14T06:26:30.084ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
88042024-11-14T06:26:30.084ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7fee2c6-b07d-49e4-ac50-975e984479cf", "content-length": "134", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} })
88052024-11-14T06:26:30.084ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
88062024-11-14T06:26:30.084ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
88072024-11-14T06:26:30.084ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
88082024-11-14T06:26:30.084ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
88092024-11-14T06:26:30.084ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88102024-11-14T06:26:30.084ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88112024-11-14T06:26:30.084ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88122024-11-14T06:26:30.084ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88132024-11-14T06:26:30.085ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88142024-11-14T06:26:30.085ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88152024-11-14T06:26:30.085ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
88162024-11-14T06:26:30.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88172024-11-14T06:26:30.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88182024-11-14T06:26:30.087ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
88192024-11-14T06:26:30.087ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "25304c97-0a78-4d50-b12e-0399a5443128", "content-length": "2", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} })
88202024-11-14T06:26:30.087ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
88212024-11-14T06:26:30.087ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9932f03d-4434-4997-9175-d0fb2b614e00", "content-length": "52", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} })
88222024-11-14T06:26:30.087ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
88232024-11-14T06:26:30.087ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
88242024-11-14T06:26:30.182ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7f3ba7ef-77e2-4f6f-9835-83832e44eeed", "date": "Thu, 14 Nov 2024 06:26:30 GMT"} })
88252024-11-14T06:26:30.182ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
88262024-11-14T06:26:30.182ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
88272024-11-14T06:26:30.183ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5b952f1-8b96-42ee-83c4-28dfe725777a", "content-length": "682", "date": "Thu, 14 Nov 2024 06:26:29 GMT"} })
88282024-11-14T06:26:30.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88292024-11-14T06:26:30.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88302024-11-14T06:26:30.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88312024-11-14T06:26:30.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88322024-11-14T06:26:30.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88332024-11-14T06:26:30.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88342024-11-14T06:26:30.193ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88352024-11-14T06:26:30.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88362024-11-14T06:26:30.201ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 809.358745ms iteration = 15 status = {}
88372024-11-14T06:26:34.740ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:59984
88382024-11-14T06:26:34.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59984 req_id = 817f3e81-b60f-46b2-b8d7-2758d8aeb6ac roles = RoleSet { roles: {} } uri = /metrics/producers
88392024-11-14T06:26:34.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59984 req_id = 817f3e81-b60f-46b2-b8d7-2758d8aeb6ac resource = Database result = Ok(()) uri = /metrics/producers
88402024-11-14T06:26:34.752ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = f9c06870-e51f-43ae-842e-1fb78f798f41
88412024-11-14T06:26:34.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12169 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59984 req_id = 817f3e81-b60f-46b2-b8d7-2758d8aeb6ac response_code = 201 uri = /metrics/producers
88422024-11-14T06:26:37.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1472 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = dad4aba2-e606-4378-823d-e9d3d5053ad4 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
88432024-11-14T06:26:39.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
88442024-11-14T06:26:39.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88452024-11-14T06:26:39.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
88462024-11-14T06:26:39.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88472024-11-14T06:26:39.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88482024-11-14T06:26:39.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88492024-11-14T06:26:39.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88502024-11-14T06:26:39.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88512024-11-14T06:26:39.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88522024-11-14T06:26:39.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.780091ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88532024-11-14T06:26:39.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88542024-11-14T06:26:39.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88552024-11-14T06:26:39.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88562024-11-14T06:26:39.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88572024-11-14T06:26:39.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88582024-11-14T06:26:39.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88592024-11-14T06:26:39.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
88602024-11-14T06:26:39.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88612024-11-14T06:26:39.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88622024-11-14T06:26:39.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
88632024-11-14T06:26:39.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.288298ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
88642024-11-14T06:26:42.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 3ab9f7c5-1837-44f3-8ca6-a24017441199 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
88652024-11-14T06:26:42.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 3ab9f7c5-1837-44f3-8ca6-a24017441199 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
88662024-11-14T06:26:42.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 3ab9f7c5-1837-44f3-8ca6-a24017441199 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
88672024-11-14T06:26:42.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = b87b78f5-d04e-4686-ae35-3d6fdbaf7f75 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
88682024-11-14T06:26:42.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = b87b78f5-d04e-4686-ae35-3d6fdbaf7f75 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
88692024-11-14T06:26:42.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = b87b78f5-d04e-4686-ae35-3d6fdbaf7f75 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
88702024-11-14T06:26:49.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
88712024-11-14T06:26:49.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
88722024-11-14T06:26:49.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88732024-11-14T06:26:49.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88742024-11-14T06:26:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88752024-11-14T06:26:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88762024-11-14T06:26:49.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88772024-11-14T06:26:49.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88782024-11-14T06:26:49.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88792024-11-14T06:26:49.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.984375ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88802024-11-14T06:26:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88812024-11-14T06:26:49.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88822024-11-14T06:26:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88832024-11-14T06:26:49.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88842024-11-14T06:26:49.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88852024-11-14T06:26:49.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88862024-11-14T06:26:49.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
88872024-11-14T06:26:49.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88882024-11-14T06:26:49.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88892024-11-14T06:26:49.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
88902024-11-14T06:26:49.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.95586ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
88912024-11-14T06:26:52.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1434 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = e71465cb-9df0-46f1-9f2e-dc9d6beeca2c response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
88922024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
88932024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88942024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
88952024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88962024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
88972024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
88982024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88992024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
89002024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89012024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
89022024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89032024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
89042024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89052024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
89062024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89072024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
89082024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
89092024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
89102024-11-14T06:26:59.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89112024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89122024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
89132024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89142024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
89152024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89162024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
89172024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
89182024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89192024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
89202024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
89212024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89222024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
89232024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89242024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
89252024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
89262024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89272024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89282024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89292024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89302024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89312024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89322024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89332024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89342024-11-14T06:26:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89352024-11-14T06:26:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89362024-11-14T06:26:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89372024-11-14T06:26:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89382024-11-14T06:26:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89392024-11-14T06:26:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89402024-11-14T06:26:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89412024-11-14T06:26:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89422024-11-14T06:26:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89432024-11-14T06:26:59.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89442024-11-14T06:26:59.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89452024-11-14T06:26:59.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89462024-11-14T06:26:59.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89472024-11-14T06:26:59.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.854781ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89482024-11-14T06:26:59.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.30538ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
89492024-11-14T06:26:59.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89502024-11-14T06:26:59.396ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89512024-11-14T06:26:59.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89522024-11-14T06:26:59.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89532024-11-14T06:26:59.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89542024-11-14T06:26:59.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89552024-11-14T06:26:59.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89562024-11-14T06:26:59.400ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 958200074 } })
89572024-11-14T06:26:59.400ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
89582024-11-14T06:26:59.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89592024-11-14T06:26:59.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89602024-11-14T06:26:59.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89612024-11-14T06:26:59.403ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89622024-11-14T06:26:59.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89632024-11-14T06:26:59.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89642024-11-14T06:26:59.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89652024-11-14T06:26:59.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89662024-11-14T06:26:59.403ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89672024-11-14T06:26:59.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89682024-11-14T06:26:59.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89692024-11-14T06:26:59.405ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.025161ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
89702024-11-14T06:26:59.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 963937660 } })
89712024-11-14T06:26:59.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
89722024-11-14T06:26:59.406ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89732024-11-14T06:26:59.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89742024-11-14T06:26:59.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89752024-11-14T06:26:59.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89762024-11-14T06:26:59.407ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 965972358 } })
89772024-11-14T06:26:59.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89782024-11-14T06:26:59.408ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
89792024-11-14T06:26:59.409ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89802024-11-14T06:26:59.409ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89812024-11-14T06:26:59.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89822024-11-14T06:26:59.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89832024-11-14T06:26:59.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89842024-11-14T06:26:59.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89852024-11-14T06:26:59.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
89862024-11-14T06:26:59.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89872024-11-14T06:26:59.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89882024-11-14T06:26:59.431ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89892024-11-14T06:26:59.431ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89902024-11-14T06:26:59.431ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89912024-11-14T06:26:59.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89922024-11-14T06:26:59.436ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
89932024-11-14T06:26:59.436ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.229232ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
89942024-11-14T06:26:59.439ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89952024-11-14T06:26:59.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89962024-11-14T06:26:59.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89972024-11-14T06:26:59.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89982024-11-14T06:26:59.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89992024-11-14T06:26:59.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90002024-11-14T06:26:59.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90012024-11-14T06:26:59.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90022024-11-14T06:26:59.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90032024-11-14T06:26:59.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90042024-11-14T06:26:59.453ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90052024-11-14T06:26:59.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90062024-11-14T06:26:59.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.768123ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90072024-11-14T06:26:59.461ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
90082024-11-14T06:26:59.461ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.742868ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
90092024-11-14T06:26:59.515ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
90102024-11-14T06:26:59.516ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90112024-11-14T06:26:59.516ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "906a3af2-e32c-46d5-abbb-0bcba145de2a", "content-length": "26", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
90122024-11-14T06:26:59.516ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90132024-11-14T06:26:59.517ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90142024-11-14T06:26:59.538ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90152024-11-14T06:26:59.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90162024-11-14T06:26:59.573ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
90172024-11-14T06:26:59.573ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90182024-11-14T06:26:59.573ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5deb745e-b82c-482b-8d65-cc87b4ffcc2c", "content-length": "26", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
90192024-11-14T06:26:59.573ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90202024-11-14T06:26:59.575ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90212024-11-14T06:26:59.659ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90222024-11-14T06:26:59.659ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90232024-11-14T06:26:59.660ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bf39f3d-b8d3-40a6-9db1-ff308697adf2", "content-length": "372", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
90242024-11-14T06:26:59.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90252024-11-14T06:26:59.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90262024-11-14T06:26:59.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90272024-11-14T06:26:59.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90282024-11-14T06:26:59.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90292024-11-14T06:26:59.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90302024-11-14T06:26:59.665ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
90312024-11-14T06:26:59.665ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90322024-11-14T06:26:59.665ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f61d940-2928-4b1e-a23e-3186c33c1d9d", "content-length": "26", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
90332024-11-14T06:26:59.665ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90342024-11-14T06:26:59.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90352024-11-14T06:26:59.668ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
90362024-11-14T06:26:59.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90372024-11-14T06:26:59.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90382024-11-14T06:26:59.669ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90392024-11-14T06:26:59.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90402024-11-14T06:26:59.669ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a72ec32c-604a-4d9d-9b7a-7017babff6c1", "content-length": "1", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
90412024-11-14T06:26:59.671ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90422024-11-14T06:26:59.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90432024-11-14T06:26:59.678ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 286.548223ms iteration = 16 status = null
90442024-11-14T06:26:59.694ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 302.934389ms iteration = 16 status = {}
90452024-11-14T06:26:59.700ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90462024-11-14T06:26:59.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90472024-11-14T06:26:59.700ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90482024-11-14T06:26:59.700ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90492024-11-14T06:26:59.700ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90502024-11-14T06:26:59.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90512024-11-14T06:26:59.705ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90522024-11-14T06:26:59.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90532024-11-14T06:26:59.706ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90542024-11-14T06:26:59.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90552024-11-14T06:26:59.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 320.935133ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90562024-11-14T06:26:59.714ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 322.861809ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
90572024-11-14T06:26:59.715ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
90582024-11-14T06:26:59.715ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90592024-11-14T06:26:59.716ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "17ca9965-c965-45d6-8662-a9aca71f6c89", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
90602024-11-14T06:26:59.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90612024-11-14T06:26:59.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90622024-11-14T06:26:59.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90632024-11-14T06:26:59.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90642024-11-14T06:26:59.721ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 329.656886ms iteration = 18 status = {"physical_disks_added":0}
90652024-11-14T06:26:59.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90662024-11-14T06:26:59.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90672024-11-14T06:26:59.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90682024-11-14T06:26:59.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
90692024-11-14T06:26:59.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90702024-11-14T06:26:59.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90712024-11-14T06:26:59.728ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90722024-11-14T06:26:59.728ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90732024-11-14T06:26:59.728ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d09947d1-13d1-479e-98bc-8c4a2d80ae47", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
90742024-11-14T06:26:59.729ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 337.685245ms iteration = 16 status = 0
90752024-11-14T06:26:59.730ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 339.115802ms iteration = 17 status = {}
90762024-11-14T06:26:59.734ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90772024-11-14T06:26:59.734ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90782024-11-14T06:26:59.734ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 343.202317ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90792024-11-14T06:26:59.737ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 346.192154ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
90802024-11-14T06:26:59.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90812024-11-14T06:26:59.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90822024-11-14T06:26:59.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90832024-11-14T06:26:59.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90842024-11-14T06:26:59.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90852024-11-14T06:26:59.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90862024-11-14T06:26:59.793ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
90872024-11-14T06:26:59.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90882024-11-14T06:26:59.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90892024-11-14T06:26:59.806ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90902024-11-14T06:26:59.806ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "00522309-0254-4672-81e4-af5396831b7d", "content-length": "134", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
90912024-11-14T06:26:59.806ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90922024-11-14T06:26:59.806ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
90932024-11-14T06:26:59.806ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90942024-11-14T06:26:59.807ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90952024-11-14T06:26:59.807ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90962024-11-14T06:26:59.807ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90972024-11-14T06:26:59.807ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90982024-11-14T06:26:59.807ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90992024-11-14T06:26:59.807ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91002024-11-14T06:26:59.807ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91012024-11-14T06:26:59.807ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
91022024-11-14T06:26:59.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91032024-11-14T06:26:59.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91042024-11-14T06:26:59.809ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91052024-11-14T06:26:59.810ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f6391d3-76db-40fd-a7dc-6acc3b55dce6", "content-length": "2", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
91062024-11-14T06:26:59.810ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
91072024-11-14T06:26:59.810ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "11bf5ee6-a41e-436c-bfca-f8a309c4d8d4", "content-length": "52", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
91082024-11-14T06:26:59.810ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
91092024-11-14T06:26:59.810ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91102024-11-14T06:26:59.847ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91112024-11-14T06:26:59.914ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1e945053-579d-4a90-b29a-224ef22a8287", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
91122024-11-14T06:26:59.914ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
91132024-11-14T06:26:59.914ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91142024-11-14T06:26:59.915ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "609e2c1f-9038-49c6-ae17-dedc2a6b03a6", "content-length": "682", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
91152024-11-14T06:26:59.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91162024-11-14T06:26:59.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91172024-11-14T06:26:59.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91182024-11-14T06:26:59.920ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "77302972-f7d9-4d69-86be-2fd08994567f", "content-length": "691", "date": "Thu, 14 Nov 2024 06:26:59 GMT"} })
91192024-11-14T06:26:59.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91202024-11-14T06:26:59.920ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
91212024-11-14T06:26:59.920ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
91222024-11-14T06:26:59.920ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
91232024-11-14T06:26:59.921ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 529.973805ms iteration = 16 status = {}
91242024-11-14T06:26:59.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91252024-11-14T06:26:59.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91262024-11-14T06:26:59.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91272024-11-14T06:26:59.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91282024-11-14T06:26:59.933ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 542.263312ms iteration = 16 status = {}
91292024-11-14T06:27:03.490ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
91302024-11-14T06:27:03.490ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
91312024-11-14T06:27:03.521ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
91322024-11-14T06:27:03.521ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:54231
91332024-11-14T06:27:03.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54231 req_id = a45c607a-9c21-443b-8e71-0d7e594b3301 roles = RoleSet { roles: {} } uri = /metrics/producers
91342024-11-14T06:27:03.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54231 req_id = a45c607a-9c21-443b-8e71-0d7e594b3301 resource = Database result = Ok(()) uri = /metrics/producers
91352024-11-14T06:27:03.565ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
91362024-11-14T06:27:03.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44721 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54231 req_id = a45c607a-9c21-443b-8e71-0d7e594b3301 response_code = 201 uri = /metrics/producers
91372024-11-14T06:27:03.566ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "a45c607a-9c21-443b-8e71-0d7e594b3301", "content-length": "41", "date": "Thu, 14 Nov 2024 06:27:03 GMT"} })
91382024-11-14T06:27:03.567ZDEBGnexus (producer-registration-task): registered with nexus successfully
91392024-11-14T06:27:03.567ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
91402024-11-14T06:27:07.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1221 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = a3f6fcb9-65f6-4f95-a814-1cf41576d397 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
91412024-11-14T06:27:09.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
91422024-11-14T06:27:09.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
91432024-11-14T06:27:09.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91442024-11-14T06:27:09.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91452024-11-14T06:27:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91462024-11-14T06:27:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91472024-11-14T06:27:09.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91482024-11-14T06:27:09.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91492024-11-14T06:27:09.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91502024-11-14T06:27:09.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91512024-11-14T06:27:09.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91522024-11-14T06:27:09.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91532024-11-14T06:27:09.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91542024-11-14T06:27:09.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
91552024-11-14T06:27:09.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91562024-11-14T06:27:09.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91572024-11-14T06:27:09.418ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
91582024-11-14T06:27:09.418ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.124535ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
91592024-11-14T06:27:09.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91602024-11-14T06:27:09.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91612024-11-14T06:27:09.429ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.275654ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91622024-11-14T06:27:14.983ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:44581
91632024-11-14T06:27:14.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44581 req_id = fa9d6819-067f-49b3-ac24-10dc551c4d93 roles = RoleSet { roles: {} } uri = /metrics/producers
91642024-11-14T06:27:14.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44581 req_id = fa9d6819-067f-49b3-ac24-10dc551c4d93 resource = Database result = Ok(()) uri = /metrics/producers
91652024-11-14T06:27:15.022ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
91662024-11-14T06:27:15.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39794 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44581 req_id = fa9d6819-067f-49b3-ac24-10dc551c4d93 response_code = 201 uri = /metrics/producers
91672024-11-14T06:27:19.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
91682024-11-14T06:27:19.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
91692024-11-14T06:27:19.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91702024-11-14T06:27:19.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91712024-11-14T06:27:19.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91722024-11-14T06:27:19.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91732024-11-14T06:27:19.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91742024-11-14T06:27:19.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91752024-11-14T06:27:19.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91762024-11-14T06:27:19.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91772024-11-14T06:27:19.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91782024-11-14T06:27:19.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91792024-11-14T06:27:19.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91802024-11-14T06:27:19.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91812024-11-14T06:27:19.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91822024-11-14T06:27:19.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
91832024-11-14T06:27:19.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91842024-11-14T06:27:19.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91852024-11-14T06:27:19.417ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
91862024-11-14T06:27:19.417ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.074615ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
91872024-11-14T06:27:19.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.294485ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91882024-11-14T06:27:21.503ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42078
91892024-11-14T06:27:21.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42078 req_id = f5429e56-97c6-4648-ad59-ef0fb77eb31d roles = RoleSet { roles: {} } uri = /metrics/producers
91902024-11-14T06:27:21.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42078 req_id = f5429e56-97c6-4648-ad59-ef0fb77eb31d resource = Database result = Ok(()) uri = /metrics/producers
91912024-11-14T06:27:21.539ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 914339bb-5810-4f30-ae08-365f08250a83
91922024-11-14T06:27:21.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36203 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42078 req_id = f5429e56-97c6-4648-ad59-ef0fb77eb31d response_code = 201 uri = /metrics/producers
91932024-11-14T06:27:22.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1066 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = e0cdc8fb-3eca-432d-aed1-98079e7b4778 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
91942024-11-14T06:27:27.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = a2b4b952-70ab-4f2c-b280-42c27edc06da roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
91952024-11-14T06:27:27.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = a2b4b952-70ab-4f2c-b280-42c27edc06da resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
91962024-11-14T06:27:27.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2644 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = a2b4b952-70ab-4f2c-b280-42c27edc06da response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
91972024-11-14T06:27:27.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 7865db06-e45e-4d9f-bbe1-0b45c2de136d roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
91982024-11-14T06:27:27.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 7865db06-e45e-4d9f-bbe1-0b45c2de136d resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
91992024-11-14T06:27:27.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 7865db06-e45e-4d9f-bbe1-0b45c2de136d response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
92002024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
92012024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92022024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
92032024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
92042024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
92052024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92062024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
92072024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92082024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
92092024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
92102024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92112024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
92122024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92132024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
92142024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
92152024-11-14T06:27:29.391ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
92162024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
92172024-11-14T06:27:29.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92182024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
92192024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92202024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92212024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
92222024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
92232024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92242024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92252024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
92262024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
92272024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92282024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92292024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
92302024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92312024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
92322024-11-14T06:27:29.391ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
92332024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
92342024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.85\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
92352024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
92362024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
92372024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92382024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92392024-11-14T06:27:29.391ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:17:29.391709635 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
92402024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
92412024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
92422024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
92432024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92442024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
92452024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92462024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
92472024-11-14T06:27:29.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92482024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
92492024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
92502024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
92512024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
92522024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
92532024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
92542024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92552024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
92562024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92572024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
92582024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
92592024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
92602024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92612024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
92622024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
92632024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92642024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92652024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92662024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92672024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92682024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92692024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92702024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92712024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
92722024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92732024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
92742024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92752024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92762024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92772024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92782024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92792024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92802024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92812024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92822024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92832024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
92842024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
92852024-11-14T06:27:29.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1505, tv_nsec: 950536801 } })
92862024-11-14T06:27:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92872024-11-14T06:27:29.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1505, tv_nsec: 950628613 } })
92882024-11-14T06:27:29.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
92892024-11-14T06:27:29.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.288814ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
92902024-11-14T06:27:29.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
92912024-11-14T06:27:29.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.232373ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
92922024-11-14T06:27:29.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92932024-11-14T06:27:29.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92942024-11-14T06:27:29.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92952024-11-14T06:27:29.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.399862ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92962024-11-14T06:27:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92972024-11-14T06:27:29.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92982024-11-14T06:27:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92992024-11-14T06:27:29.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93002024-11-14T06:27:29.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93012024-11-14T06:27:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93022024-11-14T06:27:29.398ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93032024-11-14T06:27:29.399ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:17:29.391709635 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
93042024-11-14T06:27:29.399ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.846956ms iteration = 9 status = {"expiration":"2024-11-14T06:17:29.391709635Z","pruned":[]}
93052024-11-14T06:27:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93062024-11-14T06:27:29.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93072024-11-14T06:27:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93082024-11-14T06:27:29.401ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93092024-11-14T06:27:29.401ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93102024-11-14T06:27:29.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93112024-11-14T06:27:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
93122024-11-14T06:27:29.401ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
93132024-11-14T06:27:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93142024-11-14T06:27:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93152024-11-14T06:27:29.404ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1505, tv_nsec: 961312142 } })
93162024-11-14T06:27:29.404ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
93172024-11-14T06:27:29.406ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93182024-11-14T06:27:29.407ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93192024-11-14T06:27:29.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93202024-11-14T06:27:29.408ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1505, tv_nsec: 967069299 } })
93212024-11-14T06:27:29.409ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
93222024-11-14T06:27:29.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93232024-11-14T06:27:29.409ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93242024-11-14T06:27:29.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93252024-11-14T06:27:29.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93262024-11-14T06:27:29.413ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.771405ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
93272024-11-14T06:27:29.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93282024-11-14T06:27:29.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93292024-11-14T06:27:29.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93302024-11-14T06:27:29.416ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.458383ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93312024-11-14T06:27:29.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93322024-11-14T06:27:29.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93332024-11-14T06:27:29.435ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93342024-11-14T06:27:29.436ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1505, tv_nsec: 994423158 } })
93352024-11-14T06:27:29.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93362024-11-14T06:27:29.436ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
93372024-11-14T06:27:29.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93382024-11-14T06:27:29.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93392024-11-14T06:27:29.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93402024-11-14T06:27:29.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93412024-11-14T06:27:29.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93422024-11-14T06:27:29.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93432024-11-14T06:27:29.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93442024-11-14T06:27:29.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93452024-11-14T06:27:29.449ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93462024-11-14T06:27:29.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.491519ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
93472024-11-14T06:27:29.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93482024-11-14T06:27:29.450ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93492024-11-14T06:27:29.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93502024-11-14T06:27:29.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93512024-11-14T06:27:29.452ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93522024-11-14T06:27:29.452ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
93532024-11-14T06:27:29.452ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93542024-11-14T06:27:29.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93552024-11-14T06:27:29.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93562024-11-14T06:27:29.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93572024-11-14T06:27:29.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93582024-11-14T06:27:29.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.638401ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93592024-11-14T06:27:29.461ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93602024-11-14T06:27:29.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93612024-11-14T06:27:29.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93622024-11-14T06:27:29.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93632024-11-14T06:27:29.465ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93642024-11-14T06:27:29.467ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93652024-11-14T06:27:29.467ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93662024-11-14T06:27:29.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93672024-11-14T06:27:29.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 85.129925ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
93682024-11-14T06:27:29.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93692024-11-14T06:27:29.479ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93702024-11-14T06:27:29.480ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93712024-11-14T06:27:29.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93722024-11-14T06:27:29.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93732024-11-14T06:27:29.481ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93742024-11-14T06:27:29.481ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93752024-11-14T06:27:29.481ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93762024-11-14T06:27:29.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93772024-11-14T06:27:29.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93782024-11-14T06:27:29.482ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
93792024-11-14T06:27:29.482ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
93802024-11-14T06:27:29.482ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 90.502925ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
93812024-11-14T06:27:29.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.37114ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93822024-11-14T06:27:29.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93832024-11-14T06:27:29.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93842024-11-14T06:27:29.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93852024-11-14T06:27:29.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93862024-11-14T06:27:29.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93872024-11-14T06:27:29.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
93882024-11-14T06:27:29.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93892024-11-14T06:27:29.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93902024-11-14T06:27:29.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93912024-11-14T06:27:29.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93922024-11-14T06:27:29.501ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
93932024-11-14T06:27:29.501ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
93942024-11-14T06:27:29.501ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.532149ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
93952024-11-14T06:27:29.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93962024-11-14T06:27:29.507ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93972024-11-14T06:27:29.507ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93982024-11-14T06:27:29.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93992024-11-14T06:27:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
94002024-11-14T06:27:29.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94012024-11-14T06:27:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94022024-11-14T06:27:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94032024-11-14T06:27:29.513ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94042024-11-14T06:27:29.516ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
94052024-11-14T06:27:29.516ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 124.582768ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
94062024-11-14T06:27:29.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94072024-11-14T06:27:29.518ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 126.678448ms iteration = 17 status = 0
94082024-11-14T06:27:29.520ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
94092024-11-14T06:27:29.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
94102024-11-14T06:27:29.521ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94112024-11-14T06:27:29.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94122024-11-14T06:27:29.523ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 131.968017ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
94132024-11-14T06:27:29.524ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
94142024-11-14T06:27:29.524ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 132.586558ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
94152024-11-14T06:27:29.530ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94162024-11-14T06:27:29.532ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94172024-11-14T06:27:29.532ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
94182024-11-14T06:27:29.533ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.481824ms iteration = 19 status = {"physical_disks_added":0}
94192024-11-14T06:27:29.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
94202024-11-14T06:27:29.535ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94212024-11-14T06:27:29.535ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94222024-11-14T06:27:29.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94232024-11-14T06:27:29.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94242024-11-14T06:27:29.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94252024-11-14T06:27:29.548ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
94262024-11-14T06:27:29.548ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
94272024-11-14T06:27:29.548ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
94282024-11-14T06:27:29.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94292024-11-14T06:27:29.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94302024-11-14T06:27:29.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94312024-11-14T06:27:29.551ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
94322024-11-14T06:27:29.552ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94332024-11-14T06:27:29.552ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94342024-11-14T06:27:29.552ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 160.920545ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94352024-11-14T06:27:29.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94362024-11-14T06:27:29.553ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94372024-11-14T06:27:29.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94382024-11-14T06:27:29.555ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
94392024-11-14T06:27:29.555ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
94402024-11-14T06:27:29.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94412024-11-14T06:27:29.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94422024-11-14T06:27:29.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94432024-11-14T06:27:29.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94442024-11-14T06:27:29.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94452024-11-14T06:27:29.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94462024-11-14T06:27:29.562ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
94472024-11-14T06:27:29.562ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
94482024-11-14T06:27:29.562ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
94492024-11-14T06:27:29.562ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 170.31706ms iteration = 10 status = {"generation":2}
94502024-11-14T06:27:29.563ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
94512024-11-14T06:27:29.563ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
94522024-11-14T06:27:29.563ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
94532024-11-14T06:27:29.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94542024-11-14T06:27:29.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94552024-11-14T06:27:29.565ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94562024-11-14T06:27:29.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94572024-11-14T06:27:29.570ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94582024-11-14T06:27:29.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94592024-11-14T06:27:29.573ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
94602024-11-14T06:27:29.573ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94612024-11-14T06:27:29.573ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b73cceb8-6a3e-405a-894f-b39657d8da4b", "content-length": "26", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} })
94622024-11-14T06:27:29.573ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94632024-11-14T06:27:29.577ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94642024-11-14T06:27:29.578ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94652024-11-14T06:27:29.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94662024-11-14T06:27:29.611ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
94672024-11-14T06:27:29.611ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 219.590047ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
94682024-11-14T06:27:29.612ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
94692024-11-14T06:27:29.612ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
94702024-11-14T06:27:29.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94712024-11-14T06:27:29.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94722024-11-14T06:27:29.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94732024-11-14T06:27:29.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94742024-11-14T06:27:29.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94752024-11-14T06:27:29.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94762024-11-14T06:27:29.627ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
94772024-11-14T06:27:29.627ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
94782024-11-14T06:27:29.627ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
94792024-11-14T06:27:29.627ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 235.560834ms iteration = 10 status = {"generation":1}
94802024-11-14T06:27:29.628ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94812024-11-14T06:27:29.629ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
94822024-11-14T06:27:29.629ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94832024-11-14T06:27:29.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94842024-11-14T06:27:29.688ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
94852024-11-14T06:27:29.688ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 297.331974ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
94862024-11-14T06:27:29.709ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
94872024-11-14T06:27:29.709ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94882024-11-14T06:27:29.709ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6513e067-c8b5-40c6-90c4-20769ad7f83b", "content-length": "26", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} })
94892024-11-14T06:27:29.709ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94902024-11-14T06:27:29.711ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94912024-11-14T06:27:29.725ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
94922024-11-14T06:27:29.725ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94932024-11-14T06:27:29.725ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bfddaa7-74b5-493f-af56-1ce46ec99d96", "content-length": "26", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} })
94942024-11-14T06:27:29.725ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94952024-11-14T06:27:29.727ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
94962024-11-14T06:27:29.755ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
94972024-11-14T06:27:29.774ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94982024-11-14T06:27:29.774ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
94992024-11-14T06:27:29.774ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b968fd4c-673f-4a0b-8277-122a45a3a8d1", "content-length": "691", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} })
95002024-11-14T06:27:29.774ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
95012024-11-14T06:27:29.774ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
95022024-11-14T06:27:29.774ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
95032024-11-14T06:27:29.774ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5f48baac-4552-4d56-9d77-d658044bade6", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95042024-11-14T06:27:29.774ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95052024-11-14T06:27:29.776ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "19e4e6c5-a8b6-486e-afa0-9c3229672057", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95062024-11-14T06:27:29.776ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95072024-11-14T06:27:29.777ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 385.19527ms iteration = 17 status = {}
95082024-11-14T06:27:29.778ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
95092024-11-14T06:27:29.778ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 386.731578ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
95102024-11-14T06:27:29.778ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
95112024-11-14T06:27:29.779ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0009534a-d847-4d10-88b7-6dba34d0b031", "content-length": "1", "date": "Thu, 14 Nov 2024 06:27:28 GMT"} })
95122024-11-14T06:27:29.780ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95132024-11-14T06:27:29.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95142024-11-14T06:27:29.783ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 391.341944ms iteration = 17 status = null
95152024-11-14T06:27:29.855ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95162024-11-14T06:27:29.855ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95172024-11-14T06:27:29.855ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "63d4c1d7-b384-4ffc-a5b6-0d699b8e5f98", "content-length": "372", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} })
95182024-11-14T06:27:29.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95192024-11-14T06:27:29.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95202024-11-14T06:27:29.878ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 486.969004ms iteration = 17 status = {}
95212024-11-14T06:27:29.886ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
95222024-11-14T06:27:29.886ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "da37455e-074c-4330-89ad-0ca90439a025", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95232024-11-14T06:27:29.886ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95242024-11-14T06:27:29.888ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ba56cee9-ddc6-48e5-b597-be53059abb6c", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95252024-11-14T06:27:29.888ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95262024-11-14T06:27:29.890ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e8a109e3-877e-4de9-b389-009019389f38", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95272024-11-14T06:27:29.890ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95282024-11-14T06:27:29.892ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
95292024-11-14T06:27:29.892ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 500.770401ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
95302024-11-14T06:27:29.909ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
95312024-11-14T06:27:29.909ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95322024-11-14T06:27:29.909ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1c1c027f-202c-4a67-808c-c1156b2b0884", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} })
95332024-11-14T06:27:29.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95342024-11-14T06:27:29.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95352024-11-14T06:27:29.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95362024-11-14T06:27:29.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95372024-11-14T06:27:29.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95382024-11-14T06:27:29.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95392024-11-14T06:27:29.921ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95402024-11-14T06:27:29.921ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95412024-11-14T06:27:29.921ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e33bb584-eb83-42dd-a17f-d729e58d1c0b", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} })
95422024-11-14T06:27:29.923ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 531.922781ms iteration = 18 status = {}
95432024-11-14T06:27:29.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95442024-11-14T06:27:29.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95452024-11-14T06:27:29.957ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
95462024-11-14T06:27:29.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95472024-11-14T06:27:29.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95482024-11-14T06:27:29.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95492024-11-14T06:27:29.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "89d5bd9d-fe61-4c8c-a1af-318fc14c7a6f", "content-length": "134", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} })
95502024-11-14T06:27:29.967ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
95512024-11-14T06:27:29.967ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
95522024-11-14T06:27:29.967ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95532024-11-14T06:27:29.968ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
95542024-11-14T06:27:29.968ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95552024-11-14T06:27:29.968ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95562024-11-14T06:27:29.968ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95572024-11-14T06:27:29.968ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95582024-11-14T06:27:29.968ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95592024-11-14T06:27:29.968ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95602024-11-14T06:27:29.968ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
95612024-11-14T06:27:29.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95622024-11-14T06:27:29.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95632024-11-14T06:27:29.970ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
95642024-11-14T06:27:29.970ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "864ef907-c367-419a-9c6b-4808cf2ef3e1", "content-length": "2", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} })
95652024-11-14T06:27:29.970ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
95662024-11-14T06:27:29.971ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "78725d3b-eadf-4078-a723-473a384454ec", "content-length": "52", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} })
95672024-11-14T06:27:29.971ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
95682024-11-14T06:27:29.971ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
95692024-11-14T06:27:30.169ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9d303910-b2a3-455a-be47-c5bcc24dec7b", "date": "Thu, 14 Nov 2024 06:27:30 GMT"} })
95702024-11-14T06:27:30.169ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
95712024-11-14T06:27:30.169ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95722024-11-14T06:27:30.175ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e15a741-5bfd-41ac-a4cc-048aa6247eb4", "content-length": "682", "date": "Thu, 14 Nov 2024 06:27:29 GMT"} })
95732024-11-14T06:27:30.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95742024-11-14T06:27:30.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95752024-11-14T06:27:30.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95762024-11-14T06:27:30.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95772024-11-14T06:27:30.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95782024-11-14T06:27:30.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95792024-11-14T06:27:30.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95802024-11-14T06:27:30.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95812024-11-14T06:27:30.191ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 800.048661ms iteration = 17 status = {}
95822024-11-14T06:27:37.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1284 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 4b64d479-343d-45f4-b6a5-87dc5a2c926e response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
95832024-11-14T06:27:39.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
95842024-11-14T06:27:39.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95852024-11-14T06:27:39.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
95862024-11-14T06:27:39.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95872024-11-14T06:27:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95882024-11-14T06:27:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95892024-11-14T06:27:39.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95902024-11-14T06:27:39.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95912024-11-14T06:27:39.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95922024-11-14T06:27:39.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95932024-11-14T06:27:39.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95942024-11-14T06:27:39.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95952024-11-14T06:27:39.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95962024-11-14T06:27:39.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
95972024-11-14T06:27:39.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95982024-11-14T06:27:39.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95992024-11-14T06:27:39.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
96002024-11-14T06:27:39.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.320597ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
96012024-11-14T06:27:39.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96022024-11-14T06:27:39.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96032024-11-14T06:27:39.454ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.004842ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96042024-11-14T06:27:42.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 212c4f03-16e3-4358-af50-139696a9c354 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
96052024-11-14T06:27:42.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 212c4f03-16e3-4358-af50-139696a9c354 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
96062024-11-14T06:27:42.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 212c4f03-16e3-4358-af50-139696a9c354 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
96072024-11-14T06:27:42.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = c8f2ec5e-93c6-41c4-986d-dd59e45569df roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
96082024-11-14T06:27:42.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = c8f2ec5e-93c6-41c4-986d-dd59e45569df resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
96092024-11-14T06:27:42.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = c8f2ec5e-93c6-41c4-986d-dd59e45569df response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
96102024-11-14T06:27:49.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
96112024-11-14T06:27:49.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
96122024-11-14T06:27:49.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96132024-11-14T06:27:49.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96142024-11-14T06:27:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96152024-11-14T06:27:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96162024-11-14T06:27:49.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96172024-11-14T06:27:49.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96182024-11-14T06:27:49.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96192024-11-14T06:27:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96202024-11-14T06:27:49.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96212024-11-14T06:27:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96222024-11-14T06:27:49.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96232024-11-14T06:27:49.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96242024-11-14T06:27:49.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96252024-11-14T06:27:49.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
96262024-11-14T06:27:49.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96272024-11-14T06:27:49.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96282024-11-14T06:27:49.413ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
96292024-11-14T06:27:49.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.633782ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
96302024-11-14T06:27:49.421ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.635232ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96312024-11-14T06:27:52.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 52c93e75-7307-41e5-acf4-6f294c756d52 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
96322024-11-14T06:27:57.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = c66fad99-813c-43c4-a5c7-dc99a2d315e3 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
96332024-11-14T06:27:57.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = c66fad99-813c-43c4-a5c7-dc99a2d315e3 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
96342024-11-14T06:27:57.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = c66fad99-813c-43c4-a5c7-dc99a2d315e3 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
96352024-11-14T06:27:57.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 4293f251-7d50-4a2a-8b97-8e65a1dd5541 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
96362024-11-14T06:27:57.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 4293f251-7d50-4a2a-8b97-8e65a1dd5541 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
96372024-11-14T06:27:57.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 4293f251-7d50-4a2a-8b97-8e65a1dd5541 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
96382024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
96392024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96402024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
96412024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
96422024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96432024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96442024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
96452024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
96462024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96472024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96482024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
96492024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96502024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
96512024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96522024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
96532024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
96542024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96552024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
96562024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96572024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96582024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
96592024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96602024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
96612024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96622024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
96632024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96642024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96652024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
96662024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96672024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
96682024-11-14T06:27:59.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96692024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96702024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
96712024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96722024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
96732024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96742024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96752024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96762024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96772024-11-14T06:27:59.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96782024-11-14T06:27:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96792024-11-14T06:27:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96802024-11-14T06:27:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96812024-11-14T06:27:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96822024-11-14T06:27:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96832024-11-14T06:27:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96842024-11-14T06:27:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96852024-11-14T06:27:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96862024-11-14T06:27:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96872024-11-14T06:27:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96882024-11-14T06:27:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96892024-11-14T06:27:59.394ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.007627ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
96902024-11-14T06:27:59.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96912024-11-14T06:27:59.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.812071ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96922024-11-14T06:27:59.396ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96932024-11-14T06:27:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96942024-11-14T06:27:59.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96952024-11-14T06:27:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96962024-11-14T06:27:59.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96972024-11-14T06:27:59.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96982024-11-14T06:27:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96992024-11-14T06:27:59.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97002024-11-14T06:27:59.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97012024-11-14T06:27:59.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97022024-11-14T06:27:59.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97032024-11-14T06:27:59.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97042024-11-14T06:27:59.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 964155644 } })
97052024-11-14T06:27:59.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
97062024-11-14T06:27:59.407ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 965694363 } })
97072024-11-14T06:27:59.407ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
97082024-11-14T06:27:59.409ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1535, tv_nsec: 967218271 } })
97092024-11-14T06:27:59.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97102024-11-14T06:27:59.409ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97112024-11-14T06:27:59.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97122024-11-14T06:27:59.409ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
97132024-11-14T06:27:59.409ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97142024-11-14T06:27:59.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97152024-11-14T06:27:59.412ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97162024-11-14T06:27:59.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97172024-11-14T06:27:59.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.829524ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
97182024-11-14T06:27:59.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97192024-11-14T06:27:59.456ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97202024-11-14T06:27:59.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97212024-11-14T06:27:59.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97222024-11-14T06:27:59.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97232024-11-14T06:27:59.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97242024-11-14T06:27:59.459ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97252024-11-14T06:27:59.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97262024-11-14T06:27:59.461ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97272024-11-14T06:27:59.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97282024-11-14T06:27:59.465ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97292024-11-14T06:27:59.465ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97302024-11-14T06:27:59.465ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97312024-11-14T06:27:59.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97322024-11-14T06:27:59.466ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97332024-11-14T06:27:59.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97342024-11-14T06:27:59.472ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97352024-11-14T06:27:59.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97362024-11-14T06:27:59.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97372024-11-14T06:27:59.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97382024-11-14T06:27:59.474ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97392024-11-14T06:27:59.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97402024-11-14T06:27:59.476ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97412024-11-14T06:27:59.479ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97422024-11-14T06:27:59.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
97432024-11-14T06:27:59.481ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97442024-11-14T06:27:59.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97452024-11-14T06:27:59.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97462024-11-14T06:27:59.482ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97472024-11-14T06:27:59.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97482024-11-14T06:27:59.483ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97492024-11-14T06:27:59.483ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.307338ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97502024-11-14T06:27:59.484ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 92.994151ms iteration = 18 status = 0
97512024-11-14T06:27:59.485ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97522024-11-14T06:27:59.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97532024-11-14T06:27:59.486ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97542024-11-14T06:27:59.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97552024-11-14T06:27:59.486ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
97562024-11-14T06:27:59.486ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97572024-11-14T06:27:59.487ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6138735e-ffbc-41e0-9327-40593ce614b1", "content-length": "26", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
97582024-11-14T06:27:59.487ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97592024-11-14T06:27:59.487ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
97602024-11-14T06:27:59.487ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97612024-11-14T06:27:59.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97622024-11-14T06:27:59.487ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0674895c-4c98-441d-ae9e-f08f848c2f78", "content-length": "26", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
97632024-11-14T06:27:59.487ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97642024-11-14T06:27:59.489ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97652024-11-14T06:27:59.490ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97662024-11-14T06:27:59.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
97672024-11-14T06:27:59.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97682024-11-14T06:27:59.495ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97692024-11-14T06:27:59.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97702024-11-14T06:27:59.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97712024-11-14T06:27:59.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97722024-11-14T06:27:59.508ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97732024-11-14T06:27:59.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97742024-11-14T06:27:59.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 117.447826ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
97752024-11-14T06:27:59.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97762024-11-14T06:27:59.509ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
97772024-11-14T06:27:59.509ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97782024-11-14T06:27:59.510ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a07621e-0d2f-459c-9d73-09ad1263f377", "content-length": "26", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
97792024-11-14T06:27:59.510ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97802024-11-14T06:27:59.512ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
97812024-11-14T06:27:59.513ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 121.662724ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97822024-11-14T06:27:59.514ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97832024-11-14T06:27:59.514ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97842024-11-14T06:27:59.514ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97852024-11-14T06:27:59.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97862024-11-14T06:27:59.517ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97872024-11-14T06:27:59.517ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
97882024-11-14T06:27:59.517ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.640309ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
97892024-11-14T06:27:59.518ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
97902024-11-14T06:27:59.518ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 127.135447ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
97912024-11-14T06:27:59.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 145.009329ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97922024-11-14T06:27:59.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.869933ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
97932024-11-14T06:27:59.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97942024-11-14T06:27:59.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97952024-11-14T06:27:59.617ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 226.293122ms iteration = 20 status = {"physical_disks_added":0}
97962024-11-14T06:27:59.647ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
97972024-11-14T06:27:59.647ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
97982024-11-14T06:27:59.648ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a9b730f-de50-4180-9472-82b783e595cb", "content-length": "372", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
97992024-11-14T06:27:59.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98002024-11-14T06:27:59.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98012024-11-14T06:27:59.666ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
98022024-11-14T06:27:59.666ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98032024-11-14T06:27:59.666ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "36398672-e474-418a-aeaf-b61062835f5f", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
98042024-11-14T06:27:59.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98052024-11-14T06:27:59.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98062024-11-14T06:27:59.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98072024-11-14T06:27:59.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98082024-11-14T06:27:59.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98092024-11-14T06:27:59.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98102024-11-14T06:27:59.677ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98112024-11-14T06:27:59.677ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98122024-11-14T06:27:59.677ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "38b7cfeb-2337-4313-a953-66237952886b", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
98132024-11-14T06:27:59.680ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.667673ms iteration = 19 status = {}
98142024-11-14T06:27:59.712ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98152024-11-14T06:27:59.712ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "840ad554-fb14-46b8-800e-9d9de1ecdf8f", "content-length": "1", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
98162024-11-14T06:27:59.714ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 322.821228ms iteration = 18 status = {}
98172024-11-14T06:27:59.714ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98182024-11-14T06:27:59.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98192024-11-14T06:27:59.716ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 325.005729ms iteration = 18 status = null
98202024-11-14T06:27:59.754ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98212024-11-14T06:27:59.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98222024-11-14T06:27:59.758ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
98232024-11-14T06:27:59.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98242024-11-14T06:27:59.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98252024-11-14T06:27:59.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98262024-11-14T06:27:59.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98272024-11-14T06:27:59.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98282024-11-14T06:27:59.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98292024-11-14T06:27:59.767ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98302024-11-14T06:27:59.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98312024-11-14T06:27:59.770ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
98322024-11-14T06:27:59.770ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8d73504-9f78-48eb-9b8d-d5eaeac2a14b", "content-length": "134", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
98332024-11-14T06:27:59.770ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
98342024-11-14T06:27:59.770ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
98352024-11-14T06:27:59.770ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
98362024-11-14T06:27:59.770ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
98372024-11-14T06:27:59.770ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98382024-11-14T06:27:59.770ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98392024-11-14T06:27:59.770ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98402024-11-14T06:27:59.770ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98412024-11-14T06:27:59.770ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98422024-11-14T06:27:59.770ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98432024-11-14T06:27:59.771ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
98442024-11-14T06:27:59.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98452024-11-14T06:27:59.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98462024-11-14T06:27:59.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
98472024-11-14T06:27:59.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1d8ffd0-430b-4a82-9a63-cfe9e36ef0f4", "content-length": "2", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
98482024-11-14T06:27:59.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
98492024-11-14T06:27:59.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "97fcbf1c-11a9-441a-9b61-104cdc210e59", "content-length": "52", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
98502024-11-14T06:27:59.773ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
98512024-11-14T06:27:59.773ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
98522024-11-14T06:27:59.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98532024-11-14T06:27:59.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98542024-11-14T06:27:59.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98552024-11-14T06:27:59.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98562024-11-14T06:27:59.833ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98572024-11-14T06:27:59.844ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a79f2fea-50fd-496b-988b-e1b99233ed04", "content-length": "691", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
98582024-11-14T06:27:59.844ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
98592024-11-14T06:27:59.844ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
98602024-11-14T06:27:59.844ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
98612024-11-14T06:27:59.846ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 454.957908ms iteration = 18 status = {}
98622024-11-14T06:27:59.940ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:37127
98632024-11-14T06:27:59.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37127 req_id = 5e867f00-4527-4f66-9f19-37265613e551 roles = RoleSet { roles: {} } uri = /metrics/producers
98642024-11-14T06:27:59.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37127 req_id = 5e867f00-4527-4f66-9f19-37265613e551 resource = Database result = Ok(()) uri = /metrics/producers
98652024-11-14T06:27:59.945ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "23168675-3086-47b1-a620-62f5b97b6d50", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
98662024-11-14T06:27:59.945ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
98672024-11-14T06:27:59.945ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
98682024-11-14T06:27:59.949ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d30a6a11-ede7-4be6-98dd-56525af16f5e", "content-length": "682", "date": "Thu, 14 Nov 2024 06:27:59 GMT"} })
98692024-11-14T06:27:59.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98702024-11-14T06:27:59.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98712024-11-14T06:27:59.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98722024-11-14T06:27:59.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98732024-11-14T06:27:59.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98742024-11-14T06:27:59.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98752024-11-14T06:27:59.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98762024-11-14T06:27:59.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98772024-11-14T06:27:59.966ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 574.801539ms iteration = 18 status = {}
98782024-11-14T06:27:59.982ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 07d948d3-6a47-45eb-9ed3-629b45d23b8a
98792024-11-14T06:27:59.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41614 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37127 req_id = 5e867f00-4527-4f66-9f19-37265613e551 response_code = 201 uri = /metrics/producers
98802024-11-14T06:28:07.609ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1386 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 9218546e-219a-419a-95bc-b7accdb50897 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
98812024-11-14T06:28:09.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
98822024-11-14T06:28:09.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
98832024-11-14T06:28:09.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98842024-11-14T06:28:09.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98852024-11-14T06:28:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98862024-11-14T06:28:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98872024-11-14T06:28:09.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98882024-11-14T06:28:09.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98892024-11-14T06:28:09.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98902024-11-14T06:28:09.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98912024-11-14T06:28:09.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98922024-11-14T06:28:09.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98932024-11-14T06:28:09.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98942024-11-14T06:28:09.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
98952024-11-14T06:28:09.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98962024-11-14T06:28:09.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98972024-11-14T06:28:09.417ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
98982024-11-14T06:28:09.417ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.055605ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
98992024-11-14T06:28:09.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99002024-11-14T06:28:09.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99012024-11-14T06:28:09.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.499479ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99022024-11-14T06:28:19.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
99032024-11-14T06:28:19.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
99042024-11-14T06:28:19.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99052024-11-14T06:28:19.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99062024-11-14T06:28:19.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99072024-11-14T06:28:19.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99082024-11-14T06:28:19.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99092024-11-14T06:28:19.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99102024-11-14T06:28:19.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99112024-11-14T06:28:19.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99122024-11-14T06:28:19.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99132024-11-14T06:28:19.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99142024-11-14T06:28:19.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99152024-11-14T06:28:19.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
99162024-11-14T06:28:19.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99172024-11-14T06:28:19.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99182024-11-14T06:28:19.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
99192024-11-14T06:28:19.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.008491ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
99202024-11-14T06:28:19.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99212024-11-14T06:28:19.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99222024-11-14T06:28:19.454ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.448641ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99232024-11-14T06:28:22.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1201 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 6bb8168e-e30f-4ecd-991e-69871af384ce response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
99242024-11-14T06:28:23.337ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43112
99252024-11-14T06:28:23.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43112 req_id = e5ee6521-b535-486c-a8ff-b412b702969a roles = RoleSet { roles: {} } uri = /metrics/producers
99262024-11-14T06:28:23.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43112 req_id = e5ee6521-b535-486c-a8ff-b412b702969a resource = Database result = Ok(()) uri = /metrics/producers
99272024-11-14T06:28:23.373ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6826e3df-ce47-4da7-be1a-7b4ea7b6cca4
99282024-11-14T06:28:23.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35371 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43112 req_id = e5ee6521-b535-486c-a8ff-b412b702969a response_code = 201 uri = /metrics/producers
99292024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
99302024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
99312024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
99322024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
99332024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
99342024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
99352024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99362024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
99372024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99382024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
99392024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
99402024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99412024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99422024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
99432024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
99442024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
99452024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
99462024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
99472024-11-14T06:28:29.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
99482024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99492024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
99502024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
99512024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
99522024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
99532024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
99542024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
99552024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
99562024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
99572024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
99582024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
99592024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
99602024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
99612024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99622024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
99632024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
99642024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99652024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
99662024-11-14T06:28:29.391ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
99672024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
99682024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.76\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
99692024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
99702024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99712024-11-14T06:28:29.391ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
99722024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
99732024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
99742024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99752024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
99762024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
99772024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
99782024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
99792024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
99802024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
99812024-11-14T06:28:29.391ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:18:29.391805987 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
99822024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
99832024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
99842024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
99852024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99862024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
99872024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
99882024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99892024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
99902024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99912024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
99922024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
99932024-11-14T06:28:29.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99942024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
99952024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99962024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99972024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
99982024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99992024-11-14T06:28:29.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1565, tv_nsec: 950217485 } })
100002024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100012024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100022024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100032024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100042024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100052024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100062024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
100072024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100082024-11-14T06:28:29.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1565, tv_nsec: 950406969 } })
100092024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100102024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100112024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100122024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100132024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100142024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100152024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100162024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100172024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100182024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
100192024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
100202024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100212024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100222024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100232024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
100242024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 874.607\u{b5}s iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
100252024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
100262024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.192092ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
100272024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100282024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100292024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100302024-11-14T06:28:29.392ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100312024-11-14T06:28:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100322024-11-14T06:28:29.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100332024-11-14T06:28:29.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100342024-11-14T06:28:29.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100352024-11-14T06:28:29.394ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.297961ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
100362024-11-14T06:28:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100372024-11-14T06:28:29.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100382024-11-14T06:28:29.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.659078ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100392024-11-14T06:28:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100402024-11-14T06:28:29.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100412024-11-14T06:28:29.396ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43638
100422024-11-14T06:28:29.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43638 req_id = 538da82a-7b91-4ec6-bb5a-b4b327d59f44 roles = RoleSet { roles: {} } uri = /metrics/producers
100432024-11-14T06:28:29.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43638 req_id = 538da82a-7b91-4ec6-bb5a-b4b327d59f44 resource = Database result = Ok(()) uri = /metrics/producers
100442024-11-14T06:28:29.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100452024-11-14T06:28:29.399ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1565, tv_nsec: 957461830 } })
100462024-11-14T06:28:29.399ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
100472024-11-14T06:28:29.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100482024-11-14T06:28:29.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100492024-11-14T06:28:29.400ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100502024-11-14T06:28:29.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100512024-11-14T06:28:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100522024-11-14T06:28:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100532024-11-14T06:28:29.403ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1565, tv_nsec: 961442444 } })
100542024-11-14T06:28:29.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
100552024-11-14T06:28:29.408ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100562024-11-14T06:28:29.409ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100572024-11-14T06:28:29.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100582024-11-14T06:28:29.411ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:18:29.391805987 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
100592024-11-14T06:28:29.411ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.205717ms iteration = 10 status = {"expiration":"2024-11-14T06:18:29.391805987Z","pruned":[]}
100602024-11-14T06:28:29.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
100612024-11-14T06:28:29.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100622024-11-14T06:28:29.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100632024-11-14T06:28:29.412ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100642024-11-14T06:28:29.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
100652024-11-14T06:28:29.415ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100662024-11-14T06:28:29.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100672024-11-14T06:28:29.415ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100682024-11-14T06:28:29.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
100692024-11-14T06:28:29.417ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100702024-11-14T06:28:29.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100712024-11-14T06:28:29.427ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100722024-11-14T06:28:29.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
100732024-11-14T06:28:29.430ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100742024-11-14T06:28:29.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100752024-11-14T06:28:29.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100762024-11-14T06:28:29.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
100772024-11-14T06:28:29.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100782024-11-14T06:28:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100792024-11-14T06:28:29.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100802024-11-14T06:28:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100812024-11-14T06:28:29.470ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100822024-11-14T06:28:29.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100832024-11-14T06:28:29.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100842024-11-14T06:28:29.477ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 85.378799ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
100852024-11-14T06:28:29.478ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100862024-11-14T06:28:29.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100872024-11-14T06:28:29.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100882024-11-14T06:28:29.482ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100892024-11-14T06:28:29.482ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100902024-11-14T06:28:29.482ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100912024-11-14T06:28:29.482ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100922024-11-14T06:28:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100932024-11-14T06:28:29.483ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100942024-11-14T06:28:29.483ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
100952024-11-14T06:28:29.483ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100962024-11-14T06:28:29.483ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1566, tv_nsec: 41388392 } })
100972024-11-14T06:28:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100982024-11-14T06:28:29.483ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
100992024-11-14T06:28:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
101002024-11-14T06:28:29.485ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
101012024-11-14T06:28:29.485ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
101022024-11-14T06:28:29.485ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
101032024-11-14T06:28:29.485ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 93.619042ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
101042024-11-14T06:28:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
101052024-11-14T06:28:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101062024-11-14T06:28:29.485ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101072024-11-14T06:28:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101082024-11-14T06:28:29.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101092024-11-14T06:28:29.486ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101102024-11-14T06:28:29.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101112024-11-14T06:28:29.487ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.731192ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
101122024-11-14T06:28:29.489ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101132024-11-14T06:28:29.489ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101142024-11-14T06:28:29.489ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101152024-11-14T06:28:29.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101162024-11-14T06:28:29.490ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 98.529144ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
101172024-11-14T06:28:29.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101182024-11-14T06:28:29.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101192024-11-14T06:28:29.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101202024-11-14T06:28:29.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101212024-11-14T06:28:29.492ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101222024-11-14T06:28:29.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
101232024-11-14T06:28:29.492ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101242024-11-14T06:28:29.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101252024-11-14T06:28:29.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101262024-11-14T06:28:29.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101272024-11-14T06:28:29.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101282024-11-14T06:28:29.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101292024-11-14T06:28:29.497ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101302024-11-14T06:28:29.497ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101312024-11-14T06:28:29.497ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101322024-11-14T06:28:29.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101332024-11-14T06:28:29.499ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101342024-11-14T06:28:29.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101352024-11-14T06:28:29.503ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101362024-11-14T06:28:29.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101372024-11-14T06:28:29.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101382024-11-14T06:28:29.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101392024-11-14T06:28:29.506ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101402024-11-14T06:28:29.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101412024-11-14T06:28:29.507ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 116.123582ms iteration = 5 status = {"nsuccess":5}
101422024-11-14T06:28:29.510ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101432024-11-14T06:28:29.514ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
101442024-11-14T06:28:29.514ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
101452024-11-14T06:28:29.514ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
101462024-11-14T06:28:29.514ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101472024-11-14T06:28:29.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
101482024-11-14T06:28:29.514ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101492024-11-14T06:28:29.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101502024-11-14T06:28:29.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101512024-11-14T06:28:29.516ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6cb81177-384c-420e-b49a-7c6450fab666
101522024-11-14T06:28:29.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119541 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43638 req_id = 538da82a-7b91-4ec6-bb5a-b4b327d59f44 response_code = 201 uri = /metrics/producers
101532024-11-14T06:28:29.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101542024-11-14T06:28:29.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
101552024-11-14T06:28:29.521ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101562024-11-14T06:28:29.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101572024-11-14T06:28:29.528ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
101582024-11-14T06:28:29.528ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101592024-11-14T06:28:29.528ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db76f04f-189f-4cb8-8aaa-0d71a1ec481b", "content-length": "26", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} })
101602024-11-14T06:28:29.528ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101612024-11-14T06:28:29.531ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101622024-11-14T06:28:29.537ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101632024-11-14T06:28:29.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101642024-11-14T06:28:29.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101652024-11-14T06:28:29.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
101662024-11-14T06:28:29.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
101672024-11-14T06:28:29.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
101682024-11-14T06:28:29.547ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
101692024-11-14T06:28:29.547ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101702024-11-14T06:28:29.548ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de40255f-da07-43d4-ad48-214aa3831047", "content-length": "26", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} })
101712024-11-14T06:28:29.548ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101722024-11-14T06:28:29.551ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101732024-11-14T06:28:29.554ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
101742024-11-14T06:28:29.561ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
101752024-11-14T06:28:29.561ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
101762024-11-14T06:28:29.561ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 169.675368ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
101772024-11-14T06:28:29.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 173.774904ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101782024-11-14T06:28:29.565ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
101792024-11-14T06:28:29.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101802024-11-14T06:28:29.566ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101812024-11-14T06:28:29.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101822024-11-14T06:28:29.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 178.552143ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101832024-11-14T06:28:29.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101842024-11-14T06:28:29.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
101852024-11-14T06:28:29.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101862024-11-14T06:28:29.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101872024-11-14T06:28:29.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101882024-11-14T06:28:29.573ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101892024-11-14T06:28:29.573ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 182.20748ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101902024-11-14T06:28:29.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101912024-11-14T06:28:29.575ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101922024-11-14T06:28:29.575ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
101932024-11-14T06:28:29.575ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 184.184688ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
101942024-11-14T06:28:29.582ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101952024-11-14T06:28:29.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101962024-11-14T06:28:29.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
101972024-11-14T06:28:29.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101982024-11-14T06:28:29.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101992024-11-14T06:28:29.587ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102002024-11-14T06:28:29.589ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 197.488865ms iteration = 19 status = 0
102012024-11-14T06:28:29.590ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102022024-11-14T06:28:29.590ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102032024-11-14T06:28:29.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102042024-11-14T06:28:29.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
102052024-11-14T06:28:29.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 209.222664ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
102062024-11-14T06:28:29.607ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
102072024-11-14T06:28:29.607ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
102082024-11-14T06:28:29.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102092024-11-14T06:28:29.608ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
102102024-11-14T06:28:29.608ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 216.441298ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
102112024-11-14T06:28:29.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102122024-11-14T06:28:29.608ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 217.459197ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
102132024-11-14T06:28:29.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102142024-11-14T06:28:29.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102152024-11-14T06:28:29.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102162024-11-14T06:28:29.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102172024-11-14T06:28:29.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102182024-11-14T06:28:29.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102192024-11-14T06:28:29.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102202024-11-14T06:28:29.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102212024-11-14T06:28:29.626ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
102222024-11-14T06:28:29.626ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102232024-11-14T06:28:29.626ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
102242024-11-14T06:28:29.626ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
102252024-11-14T06:28:29.626ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 234.887381ms iteration = 11 status = {"generation":1}
102262024-11-14T06:28:29.626ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
102272024-11-14T06:28:29.627ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
102282024-11-14T06:28:29.627ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
102292024-11-14T06:28:29.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102302024-11-14T06:28:29.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102312024-11-14T06:28:29.628ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102322024-11-14T06:28:29.628ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102332024-11-14T06:28:29.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102342024-11-14T06:28:29.631ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102352024-11-14T06:28:29.634ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102362024-11-14T06:28:29.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102372024-11-14T06:28:29.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102382024-11-14T06:28:29.658ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
102392024-11-14T06:28:29.658ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 267.01639ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
102402024-11-14T06:28:29.685ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 294.198205ms iteration = 21 status = {"physical_disks_added":0}
102412024-11-14T06:28:29.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102422024-11-14T06:28:29.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102432024-11-14T06:28:29.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102442024-11-14T06:28:29.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102452024-11-14T06:28:29.781ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
102462024-11-14T06:28:29.795ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
102472024-11-14T06:28:29.796ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1305e69c-a5c6-4a6b-b48e-1aed303cdd23", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102482024-11-14T06:28:29.796ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102492024-11-14T06:28:29.799ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "41917905-7f47-4fd8-bc98-fb0bb9bf6b0e", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102502024-11-14T06:28:29.799ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102512024-11-14T06:28:29.800ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102522024-11-14T06:28:29.800ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 409.173435ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
102532024-11-14T06:28:29.810ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
102542024-11-14T06:28:29.810ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102552024-11-14T06:28:29.810ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "18e5d691-501a-426c-a344-af5e4a65cece", "content-length": "26", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} })
102562024-11-14T06:28:29.810ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102572024-11-14T06:28:29.812ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
102582024-11-14T06:28:29.819ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102592024-11-14T06:28:29.819ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102602024-11-14T06:28:29.819ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcdddd2d-c075-4d0d-a629-ec8a8164607b", "content-length": "372", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} })
102612024-11-14T06:28:29.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102622024-11-14T06:28:29.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102632024-11-14T06:28:29.857ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
102642024-11-14T06:28:29.857ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
102652024-11-14T06:28:29.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102662024-11-14T06:28:29.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102672024-11-14T06:28:29.871ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 479.697498ms iteration = 19 status = {}
102682024-11-14T06:28:29.876ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
102692024-11-14T06:28:29.876ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102702024-11-14T06:28:29.876ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6817170e-a789-447a-8db7-bcb2caf36046", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} })
102712024-11-14T06:28:29.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102722024-11-14T06:28:29.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102732024-11-14T06:28:29.877ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
102742024-11-14T06:28:29.877ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d4b47cd-ed47-40c0-b426-1514f962f90b", "content-length": "1", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} })
102752024-11-14T06:28:29.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102762024-11-14T06:28:29.879ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102772024-11-14T06:28:29.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102782024-11-14T06:28:29.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102792024-11-14T06:28:29.884ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 492.722491ms iteration = 19 status = null
102802024-11-14T06:28:29.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102812024-11-14T06:28:29.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102822024-11-14T06:28:29.892ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102832024-11-14T06:28:29.892ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102842024-11-14T06:28:29.892ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "75233567-af6a-4b25-a90d-a780eca0fb5d", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} })
102852024-11-14T06:28:29.894ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 503.039573ms iteration = 20 status = {}
102862024-11-14T06:28:29.900ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
102872024-11-14T06:28:29.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102882024-11-14T06:28:29.900ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "56d0f723-b28f-4ec0-addc-0b9889db9f70", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
102892024-11-14T06:28:29.900ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
102902024-11-14T06:28:29.902ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ccd0e033-58f3-4cae-997f-d3edb6c4207c", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
102912024-11-14T06:28:29.902ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
102922024-11-14T06:28:29.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102932024-11-14T06:28:29.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102942024-11-14T06:28:29.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102952024-11-14T06:28:29.904ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ce624229-bcdb-4eca-9180-1707aa24150d", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
102962024-11-14T06:28:29.904ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
102972024-11-14T06:28:29.906ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
102982024-11-14T06:28:29.907ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 515.471665ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
102992024-11-14T06:28:29.976ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103002024-11-14T06:28:29.977ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d8618bb-8f93-4710-85d3-e9c586158887", "content-length": "691", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} })
103012024-11-14T06:28:29.977ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
103022024-11-14T06:28:29.977ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
103032024-11-14T06:28:29.977ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
103042024-11-14T06:28:29.978ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 586.823312ms iteration = 19 status = {}
103052024-11-14T06:28:29.979ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
103062024-11-14T06:28:29.979ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
103072024-11-14T06:28:29.979ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
103082024-11-14T06:28:29.979ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 587.570546ms iteration = 11 status = {"generation":2}
103092024-11-14T06:28:30.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103102024-11-14T06:28:30.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103112024-11-14T06:28:30.015ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
103122024-11-14T06:28:30.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103132024-11-14T06:28:30.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103142024-11-14T06:28:30.029ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103152024-11-14T06:28:30.029ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9229529-251b-4887-a2be-40cf1736b9cd", "content-length": "134", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} })
103162024-11-14T06:28:30.029ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103172024-11-14T06:28:30.029ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
103182024-11-14T06:28:30.029ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103192024-11-14T06:28:30.029ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103202024-11-14T06:28:30.029ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103212024-11-14T06:28:30.029ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103222024-11-14T06:28:30.029ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103232024-11-14T06:28:30.029ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103242024-11-14T06:28:30.030ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103252024-11-14T06:28:30.030ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103262024-11-14T06:28:30.030ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
103272024-11-14T06:28:30.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103282024-11-14T06:28:30.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103292024-11-14T06:28:30.033ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103302024-11-14T06:28:30.033ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c06e30da-fd28-435f-bac6-f49258244f1e", "content-length": "2", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} })
103312024-11-14T06:28:30.033ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103322024-11-14T06:28:30.033ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea29e0a2-ffc4-4658-b2d4-7c31b473526a", "content-length": "52", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} })
103332024-11-14T06:28:30.033ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
103342024-11-14T06:28:30.033ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103352024-11-14T06:28:30.148ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "01f03325-ed97-4f55-85cd-1b097ba5ace4", "date": "Thu, 14 Nov 2024 06:28:29 GMT"} })
103362024-11-14T06:28:30.148ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
103372024-11-14T06:28:30.148ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103382024-11-14T06:28:30.148ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe0fee0a-fc2c-4abe-a624-9c56d88aa511", "content-length": "682", "date": "Thu, 14 Nov 2024 06:28:30 GMT"} })
103392024-11-14T06:28:30.148ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103402024-11-14T06:28:30.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103412024-11-14T06:28:30.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103422024-11-14T06:28:30.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103432024-11-14T06:28:30.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103442024-11-14T06:28:30.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103452024-11-14T06:28:30.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103462024-11-14T06:28:30.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103472024-11-14T06:28:30.167ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 776.120146ms iteration = 19 status = {}
103482024-11-14T06:28:37.607ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1333 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 12439b92-bfac-4440-b9d1-1c900270728a response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
103492024-11-14T06:28:39.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
103502024-11-14T06:28:39.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103512024-11-14T06:28:39.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
103522024-11-14T06:28:39.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103532024-11-14T06:28:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103542024-11-14T06:28:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103552024-11-14T06:28:39.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103562024-11-14T06:28:39.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103572024-11-14T06:28:39.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103582024-11-14T06:28:39.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.137246ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103592024-11-14T06:28:39.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103602024-11-14T06:28:39.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103612024-11-14T06:28:39.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103622024-11-14T06:28:39.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103632024-11-14T06:28:39.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103642024-11-14T06:28:39.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103652024-11-14T06:28:39.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
103662024-11-14T06:28:39.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103672024-11-14T06:28:39.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103682024-11-14T06:28:39.415ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
103692024-11-14T06:28:39.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.255112ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
103702024-11-14T06:28:49.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
103712024-11-14T06:28:49.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
103722024-11-14T06:28:49.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103732024-11-14T06:28:49.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103742024-11-14T06:28:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103752024-11-14T06:28:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103762024-11-14T06:28:49.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103772024-11-14T06:28:49.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103782024-11-14T06:28:49.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103792024-11-14T06:28:49.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.126507ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103802024-11-14T06:28:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103812024-11-14T06:28:49.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103822024-11-14T06:28:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103832024-11-14T06:28:49.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103842024-11-14T06:28:49.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103852024-11-14T06:28:49.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103862024-11-14T06:28:49.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
103872024-11-14T06:28:49.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103882024-11-14T06:28:49.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103892024-11-14T06:28:49.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
103902024-11-14T06:28:49.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.198035ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
103912024-11-14T06:28:52.605ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1118 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = f62f6f00-e5bd-41f0-b017-820efc5045df response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
103922024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
103932024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103942024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
103952024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
103962024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103972024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
103982024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
103992024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104002024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
104012024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
104022024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
104032024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
104042024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
104052024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104062024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
104072024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104082024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104092024-11-14T06:28:59.391ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
104102024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104112024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
104122024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
104132024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104142024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
104152024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
104162024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
104172024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
104182024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104192024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
104202024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104212024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
104222024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
104232024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104242024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
104252024-11-14T06:28:59.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
104262024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104272024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
104282024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
104292024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104302024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104312024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104322024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104332024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
104342024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104352024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
104362024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104372024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
104382024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104392024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104402024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
104412024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104422024-11-14T06:28:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104432024-11-14T06:28:59.394ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 953015977 } })
104442024-11-14T06:28:59.395ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
104452024-11-14T06:28:59.395ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 953415245 } })
104462024-11-14T06:28:59.395ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104472024-11-14T06:28:59.395ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
104482024-11-14T06:28:59.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104492024-11-14T06:28:59.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.261679ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
104502024-11-14T06:28:59.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.749848ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
104512024-11-14T06:28:59.396ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104522024-11-14T06:28:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
104532024-11-14T06:28:59.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104542024-11-14T06:28:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104552024-11-14T06:28:59.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
104562024-11-14T06:28:59.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104572024-11-14T06:28:59.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104582024-11-14T06:28:59.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
104592024-11-14T06:28:59.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104602024-11-14T06:28:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104612024-11-14T06:28:59.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104622024-11-14T06:28:59.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104632024-11-14T06:28:59.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104642024-11-14T06:28:59.401ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104652024-11-14T06:28:59.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104662024-11-14T06:28:59.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104672024-11-14T06:28:59.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104682024-11-14T06:28:59.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104692024-11-14T06:28:59.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104702024-11-14T06:28:59.404ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104712024-11-14T06:28:59.404ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
104722024-11-14T06:28:59.404ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104732024-11-14T06:28:59.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104742024-11-14T06:28:59.405ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104752024-11-14T06:28:59.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104762024-11-14T06:28:59.406ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104772024-11-14T06:28:59.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104782024-11-14T06:28:59.406ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1595, tv_nsec: 964658674 } })
104792024-11-14T06:28:59.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104802024-11-14T06:28:59.406ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104812024-11-14T06:28:59.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104822024-11-14T06:28:59.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
104832024-11-14T06:28:59.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104842024-11-14T06:28:59.409ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104852024-11-14T06:28:59.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104862024-11-14T06:28:59.409ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 17.778211ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104872024-11-14T06:28:59.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104882024-11-14T06:28:59.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104892024-11-14T06:28:59.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104902024-11-14T06:28:59.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104912024-11-14T06:28:59.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104922024-11-14T06:28:59.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104932024-11-14T06:28:59.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
104942024-11-14T06:28:59.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104952024-11-14T06:28:59.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104962024-11-14T06:28:59.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104972024-11-14T06:28:59.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104982024-11-14T06:28:59.449ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
104992024-11-14T06:28:59.449ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.421129ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
105002024-11-14T06:28:59.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.986396ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
105012024-11-14T06:28:59.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105022024-11-14T06:28:59.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105032024-11-14T06:28:59.459ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105042024-11-14T06:28:59.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105052024-11-14T06:28:59.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105062024-11-14T06:28:59.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105072024-11-14T06:28:59.465ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105082024-11-14T06:28:59.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105092024-11-14T06:28:59.467ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105102024-11-14T06:28:59.467ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
105112024-11-14T06:28:59.467ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105122024-11-14T06:28:59.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105132024-11-14T06:28:59.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105142024-11-14T06:28:59.470ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
105152024-11-14T06:28:59.470ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.305457ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
105162024-11-14T06:28:59.470ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105172024-11-14T06:28:59.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105182024-11-14T06:28:59.471ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105192024-11-14T06:28:59.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105202024-11-14T06:28:59.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
105212024-11-14T06:28:59.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105222024-11-14T06:28:59.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105232024-11-14T06:28:59.476ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.865489ms iteration = 20 status = 0
105242024-11-14T06:28:59.476ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
105252024-11-14T06:28:59.476ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105262024-11-14T06:28:59.477ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8154db47-9e0f-4932-b452-9fff705667bd", "content-length": "26", "date": "Thu, 14 Nov 2024 06:28:59 GMT"} })
105272024-11-14T06:28:59.477ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105282024-11-14T06:28:59.478ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105292024-11-14T06:28:59.481ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
105302024-11-14T06:28:59.481ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105312024-11-14T06:28:59.481ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f7d3a71-f591-44e1-842e-82ab32eb48b2", "content-length": "26", "date": "Thu, 14 Nov 2024 06:28:59 GMT"} })
105322024-11-14T06:28:59.481ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105332024-11-14T06:28:59.483ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105342024-11-14T06:28:59.488ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
105352024-11-14T06:28:59.488ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105362024-11-14T06:28:59.488ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "14d8c48a-211e-44e3-baab-d66156798612", "content-length": "26", "date": "Thu, 14 Nov 2024 06:28:59 GMT"} })
105372024-11-14T06:28:59.488ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105382024-11-14T06:28:59.490ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
105392024-11-14T06:28:59.495ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105402024-11-14T06:28:59.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105412024-11-14T06:28:59.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.29404ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
105422024-11-14T06:28:59.510ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105432024-11-14T06:28:59.510ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
105442024-11-14T06:28:59.510ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.939844ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
105452024-11-14T06:28:59.511ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 119.947212ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
105462024-11-14T06:28:59.516ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 124.309334ms iteration = 22 status = {"physical_disks_added":0}
105472024-11-14T06:28:59.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.861898ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
105482024-11-14T06:28:59.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105492024-11-14T06:28:59.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105502024-11-14T06:28:59.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105512024-11-14T06:28:59.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105522024-11-14T06:28:59.612ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105532024-11-14T06:28:59.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105542024-11-14T06:28:59.615ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105552024-11-14T06:28:59.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105562024-11-14T06:28:59.617ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105572024-11-14T06:28:59.618ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
105582024-11-14T06:28:59.618ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105592024-11-14T06:28:59.619ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e23586ee-c4e8-4b18-ba52-c8d7e486ef3d", "content-length": "372", "date": "Thu, 14 Nov 2024 06:28:59 GMT"} })
105602024-11-14T06:28:59.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105612024-11-14T06:28:59.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105622024-11-14T06:28:59.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105632024-11-14T06:28:59.620ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105642024-11-14T06:28:59.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105652024-11-14T06:28:59.684ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
105662024-11-14T06:28:59.684ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
105672024-11-14T06:28:59.684ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8259d0c5-6939-4d6a-ae53-2b573e236155", "date": "Thu, 14 Nov 2024 06:28:59 GMT"} })
105682024-11-14T06:28:59.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105692024-11-14T06:28:59.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105702024-11-14T06:28:59.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105712024-11-14T06:28:59.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105722024-11-14T06:28:59.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105732024-11-14T06:28:59.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105742024-11-14T06:28:59.695ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
105752024-11-14T06:28:59.695ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105762024-11-14T06:28:59.695ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c9d3a35a-ebd9-4bf6-9bcc-a0c51710ac24", "date": "Thu, 14 Nov 2024 06:28:59 GMT"} })
105772024-11-14T06:28:59.695ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 304.239942ms iteration = 20 status = {}
105782024-11-14T06:28:59.697ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 305.307202ms iteration = 21 status = {}
105792024-11-14T06:28:59.704ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
105802024-11-14T06:28:59.705ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "be02d721-11da-4e87-9020-f026e42e7972", "content-length": "1", "date": "Thu, 14 Nov 2024 06:28:58 GMT"} })
105812024-11-14T06:28:59.706ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105822024-11-14T06:28:59.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105832024-11-14T06:28:59.709ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 317.770234ms iteration = 20 status = null
105842024-11-14T06:28:59.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105852024-11-14T06:28:59.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105862024-11-14T06:28:59.764ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
105872024-11-14T06:28:59.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105882024-11-14T06:28:59.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105892024-11-14T06:28:59.769ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
105902024-11-14T06:28:59.774ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
105912024-11-14T06:28:59.774ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "22d5339a-ade8-4269-9eb4-7abee8bc3cd3", "content-length": "134", "date": "Thu, 14 Nov 2024 06:28:58 GMT"} })
105922024-11-14T06:28:59.774ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
105932024-11-14T06:28:59.774ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
105942024-11-14T06:28:59.775ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
105952024-11-14T06:28:59.775ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
105962024-11-14T06:28:59.775ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105972024-11-14T06:28:59.775ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105982024-11-14T06:28:59.775ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105992024-11-14T06:28:59.775ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106002024-11-14T06:28:59.775ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106012024-11-14T06:28:59.775ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106022024-11-14T06:28:59.775ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
106032024-11-14T06:28:59.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106042024-11-14T06:28:59.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106052024-11-14T06:28:59.777ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
106062024-11-14T06:28:59.777ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "737fdeeb-96bf-420e-992b-5565b5e33b11", "content-length": "2", "date": "Thu, 14 Nov 2024 06:28:58 GMT"} })
106072024-11-14T06:28:59.777ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
106082024-11-14T06:28:59.778ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "45d7eb7c-d62d-458b-8050-d7caf8a8a556", "content-length": "52", "date": "Thu, 14 Nov 2024 06:28:58 GMT"} })
106092024-11-14T06:28:59.778ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
106102024-11-14T06:28:59.778ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
106112024-11-14T06:28:59.841ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "186f473c-2014-4614-84f4-0c1d41b03b91", "content-length": "691", "date": "Thu, 14 Nov 2024 06:28:59 GMT"} })
106122024-11-14T06:28:59.841ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
106132024-11-14T06:28:59.841ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
106142024-11-14T06:28:59.841ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
106152024-11-14T06:28:59.843ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 451.461443ms iteration = 20 status = {}
106162024-11-14T06:28:59.941ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "65e3c77c-7bcb-4eb2-85d4-9610d48f1bd1", "date": "Thu, 14 Nov 2024 06:28:59 GMT"} })
106172024-11-14T06:28:59.941ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
106182024-11-14T06:28:59.941ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
106192024-11-14T06:28:59.947ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b032943-5717-4a64-9307-ce2be5263242", "content-length": "682", "date": "Thu, 14 Nov 2024 06:28:59 GMT"} })
106202024-11-14T06:28:59.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106212024-11-14T06:28:59.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106222024-11-14T06:28:59.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106232024-11-14T06:28:59.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106242024-11-14T06:28:59.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106252024-11-14T06:28:59.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106262024-11-14T06:28:59.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106272024-11-14T06:28:59.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106282024-11-14T06:28:59.963ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 571.329064ms iteration = 20 status = {}
106292024-11-14T06:29:04.790ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:48078
106302024-11-14T06:29:04.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48078 req_id = 961d82f2-d79e-474b-95f0-d0eef70ec00e roles = RoleSet { roles: {} } uri = /metrics/producers
106312024-11-14T06:29:04.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48078 req_id = 961d82f2-d79e-474b-95f0-d0eef70ec00e resource = Database result = Ok(()) uri = /metrics/producers
106322024-11-14T06:29:04.832ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = f9c06870-e51f-43ae-842e-1fb78f798f41
106332024-11-14T06:29:04.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41753 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48078 req_id = 961d82f2-d79e-474b-95f0-d0eef70ec00e response_code = 201 uri = /metrics/producers
106342024-11-14T06:29:07.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1150 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 94d86465-fab2-4ceb-b702-801bb8a238f6 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
106352024-11-14T06:29:09.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
106362024-11-14T06:29:09.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106372024-11-14T06:29:09.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
106382024-11-14T06:29:09.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106392024-11-14T06:29:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106402024-11-14T06:29:09.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106412024-11-14T06:29:09.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106422024-11-14T06:29:09.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106432024-11-14T06:29:09.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106442024-11-14T06:29:09.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106452024-11-14T06:29:09.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106462024-11-14T06:29:09.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106472024-11-14T06:29:09.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106482024-11-14T06:29:09.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
106492024-11-14T06:29:09.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106502024-11-14T06:29:09.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106512024-11-14T06:29:09.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
106522024-11-14T06:29:09.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.598954ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
106532024-11-14T06:29:09.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106542024-11-14T06:29:09.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106552024-11-14T06:29:09.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.807573ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106562024-11-14T06:29:19.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
106572024-11-14T06:29:19.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
106582024-11-14T06:29:19.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106592024-11-14T06:29:19.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106602024-11-14T06:29:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106612024-11-14T06:29:19.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106622024-11-14T06:29:19.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106632024-11-14T06:29:19.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106642024-11-14T06:29:19.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106652024-11-14T06:29:19.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.895197ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106662024-11-14T06:29:19.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106672024-11-14T06:29:19.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106682024-11-14T06:29:19.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106692024-11-14T06:29:19.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106702024-11-14T06:29:19.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106712024-11-14T06:29:19.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106722024-11-14T06:29:19.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
106732024-11-14T06:29:19.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106742024-11-14T06:29:19.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106752024-11-14T06:29:19.488ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
106762024-11-14T06:29:19.488ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.529237ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
106772024-11-14T06:29:22.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1056 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 00e23d2e-b591-4e61-9378-43594cfbaa8e response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
106782024-11-14T06:29:27.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = f12d02b5-9900-44c5-86cf-bfd18973c751 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
106792024-11-14T06:29:27.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = f12d02b5-9900-44c5-86cf-bfd18973c751 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
106802024-11-14T06:29:27.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = f12d02b5-9900-44c5-86cf-bfd18973c751 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
106812024-11-14T06:29:27.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 42f331bd-1d91-4293-900f-f25ad3a940e1 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
106822024-11-14T06:29:27.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 42f331bd-1d91-4293-900f-f25ad3a940e1 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
106832024-11-14T06:29:27.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 42f331bd-1d91-4293-900f-f25ad3a940e1 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
106842024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
106852024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106862024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
106872024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106882024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
106892024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
106902024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
106912024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
106922024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106932024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106942024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
106952024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106962024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
106972024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106982024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
106992024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
107002024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
107012024-11-14T06:29:29.391ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
107022024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
107032024-11-14T06:29:29.391ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
107042024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
107052024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107062024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
107072024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
107082024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107092024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
107102024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
107112024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
107122024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
107132024-11-14T06:29:29.391ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 06:19:29.391874798 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
107142024-11-14T06:29:29.391ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
107152024-11-14T06:29:29.391ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
107162024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
107172024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
107182024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
107192024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107202024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107212024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
107222024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
107232024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
107242024-11-14T06:29:29.392ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1d98d624-72d4-4466-8fe7-990461a3f886
107252024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.27\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"1d98d624-72d4-4466-8fe7-990461a3f886"}
107262024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
107272024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
107282024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107292024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
107302024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107312024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
107322024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107332024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
107342024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
107352024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107362024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107372024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
107382024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
107392024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
107402024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
107412024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
107422024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
107432024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
107442024-11-14T06:29:29.392ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
107452024-11-14T06:29:29.392ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
107462024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
107472024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
107482024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107492024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
107502024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
107512024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
107522024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
107532024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107542024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107552024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107562024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
107572024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107582024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
107592024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107602024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107612024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
107622024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
107632024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107642024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
107652024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107662024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
107672024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
107682024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107692024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107702024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107712024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107722024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107732024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
107742024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107752024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107762024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
107772024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107782024-11-14T06:29:29.392ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
107792024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
107802024-11-14T06:29:29.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36c202a9-b541-4083-88f5-ff6483340b34.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("78c1624f-34e7-40fb-a468-bb6354445b73.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40cb6d7-78a4-49d0-ae26-45907e21e06a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 950781396 } })
107812024-11-14T06:29:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107822024-11-14T06:29:29.392ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("720ac48b-8596-4763-a661-482d124c0a16.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f40de7f6-4bc1-4578-baeb-b08e777b4bed.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 950911638 } })
107832024-11-14T06:29:29.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
107842024-11-14T06:29:29.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.231623ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
107852024-11-14T06:29:29.393ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
107862024-11-14T06:29:29.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.259864ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
107872024-11-14T06:29:29.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107882024-11-14T06:29:29.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107892024-11-14T06:29:29.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107902024-11-14T06:29:29.395ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 953880603 } })
107912024-11-14T06:29:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
107922024-11-14T06:29:29.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107932024-11-14T06:29:29.395ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.024545ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
107942024-11-14T06:29:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107952024-11-14T06:29:29.396ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
107962024-11-14T06:29:29.396ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.498363ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
107972024-11-14T06:29:29.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107982024-11-14T06:29:29.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107992024-11-14T06:29:29.399ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108002024-11-14T06:29:29.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108012024-11-14T06:29:29.399ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 06:19:29.391874798 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
108022024-11-14T06:29:29.399ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.844146ms iteration = 11 status = {"expiration":"2024-11-14T06:19:29.391874798Z","pruned":[]}
108032024-11-14T06:29:29.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108042024-11-14T06:29:29.400ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108052024-11-14T06:29:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
108062024-11-14T06:29:29.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108072024-11-14T06:29:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108082024-11-14T06:29:29.402ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
108092024-11-14T06:29:29.402ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
108102024-11-14T06:29:29.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108112024-11-14T06:29:29.403ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 961571736 } })
108122024-11-14T06:29:29.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
108132024-11-14T06:29:29.406ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108142024-11-14T06:29:29.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108152024-11-14T06:29:29.413ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1625, tv_nsec: 971346098 } })
108162024-11-14T06:29:29.413ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
108172024-11-14T06:29:29.422ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108182024-11-14T06:29:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108192024-11-14T06:29:29.459ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108202024-11-14T06:29:29.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108212024-11-14T06:29:29.464ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108222024-11-14T06:29:29.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108232024-11-14T06:29:29.466ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108242024-11-14T06:29:29.466ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
108252024-11-14T06:29:29.466ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108262024-11-14T06:29:29.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108272024-11-14T06:29:29.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108282024-11-14T06:29:29.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.20936ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
108292024-11-14T06:29:29.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
108302024-11-14T06:29:29.467ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
108312024-11-14T06:29:29.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
108322024-11-14T06:29:29.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
108332024-11-14T06:29:29.468ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108342024-11-14T06:29:29.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108352024-11-14T06:29:29.469ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108362024-11-14T06:29:29.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108372024-11-14T06:29:29.469ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108382024-11-14T06:29:29.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108392024-11-14T06:29:29.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108402024-11-14T06:29:29.476ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108412024-11-14T06:29:29.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108422024-11-14T06:29:29.478ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108432024-11-14T06:29:29.479ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108442024-11-14T06:29:29.480ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108452024-11-14T06:29:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
108462024-11-14T06:29:29.483ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108472024-11-14T06:29:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108482024-11-14T06:29:29.484ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108492024-11-14T06:29:29.484ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108502024-11-14T06:29:29.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108512024-11-14T06:29:29.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108522024-11-14T06:29:29.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108532024-11-14T06:29:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108542024-11-14T06:29:29.487ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
108552024-11-14T06:29:29.487ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
108562024-11-14T06:29:29.487ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
108572024-11-14T06:29:29.487ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
108582024-11-14T06:29:29.487ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 3ee876b4-c0f8-49d4-818a-5ec21497ed05
108592024-11-14T06:29:29.487ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 941474d3-6904-4a90-8570-1d1ce9f47f37
108602024-11-14T06:29:29.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108612024-11-14T06:29:29.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108622024-11-14T06:29:29.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108632024-11-14T06:29:29.488ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108642024-11-14T06:29:29.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108652024-11-14T06:29:29.489ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
108662024-11-14T06:29:29.489ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
108672024-11-14T06:29:29.489ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 97.490274ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
108682024-11-14T06:29:29.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108692024-11-14T06:29:29.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108702024-11-14T06:29:29.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108712024-11-14T06:29:29.490ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 94eb89a4-12db-4aec-a0fc-a54ce8fe8a0a
108722024-11-14T06:29:29.490ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 98.707637ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
108732024-11-14T06:29:29.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108742024-11-14T06:29:29.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.217355ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108752024-11-14T06:29:29.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 100.412239ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
108762024-11-14T06:29:29.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108772024-11-14T06:29:29.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108782024-11-14T06:29:29.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
108792024-11-14T06:29:29.497ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108802024-11-14T06:29:29.498ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
108812024-11-14T06:29:29.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
108822024-11-14T06:29:29.499ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108832024-11-14T06:29:29.500ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(0d34574e-3a0d-49bb-b1f1-342637aa0810, 0), (56a09639-464f-48bf-b120-9ccdf0987326, 0), (feba1a29-4c10-4492-a815-c97085a474b4, 0), (b1d70c97-efc9-4fbd-a649-842759ce153f, 0)] collection_id = 0d34574e-3a0d-49bb-b1f1-342637aa0810
108842024-11-14T06:29:29.500ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
108852024-11-14T06:29:29.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108862024-11-14T06:29:29.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108872024-11-14T06:29:29.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108882024-11-14T06:29:29.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108892024-11-14T06:29:29.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
108902024-11-14T06:29:29.501ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108912024-11-14T06:29:29.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108922024-11-14T06:29:29.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108932024-11-14T06:29:29.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108942024-11-14T06:29:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108952024-11-14T06:29:29.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
108962024-11-14T06:29:29.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108972024-11-14T06:29:29.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108982024-11-14T06:29:29.524ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
108992024-11-14T06:29:29.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
109002024-11-14T06:29:29.526ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
109012024-11-14T06:29:29.533ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
109022024-11-14T06:29:29.533ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 141.844511ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
109032024-11-14T06:29:29.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109042024-11-14T06:29:29.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109052024-11-14T06:29:29.554ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
109062024-11-14T06:29:29.554ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 162.358512ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
109072024-11-14T06:29:29.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109082024-11-14T06:29:29.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109092024-11-14T06:29:29.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 169.795711ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
109102024-11-14T06:29:29.563ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109112024-11-14T06:29:29.563ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
109122024-11-14T06:29:29.563ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
109132024-11-14T06:29:29.563ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 171.754226ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
109142024-11-14T06:29:29.563ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
109152024-11-14T06:29:29.563ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
109162024-11-14T06:29:29.563ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
109172024-11-14T06:29:29.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109182024-11-14T06:29:29.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109192024-11-14T06:29:29.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109202024-11-14T06:29:29.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109212024-11-14T06:29:29.566ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109222024-11-14T06:29:29.566ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
109232024-11-14T06:29:29.566ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109242024-11-14T06:29:29.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109252024-11-14T06:29:29.567ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
109262024-11-14T06:29:29.567ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
109272024-11-14T06:29:29.567ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
109282024-11-14T06:29:29.567ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109292024-11-14T06:29:29.568ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109302024-11-14T06:29:29.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109312024-11-14T06:29:29.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
109322024-11-14T06:29:29.570ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109332024-11-14T06:29:29.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109342024-11-14T06:29:29.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109352024-11-14T06:29:29.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109362024-11-14T06:29:29.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
109372024-11-14T06:29:29.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109382024-11-14T06:29:29.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109392024-11-14T06:29:29.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109402024-11-14T06:29:29.575ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
109412024-11-14T06:29:29.575ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109422024-11-14T06:29:29.575ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109432024-11-14T06:29:29.576ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcc3f5a2-64c7-4471-a888-a98b703bef3e", "content-length": "26", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
109442024-11-14T06:29:29.576ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109452024-11-14T06:29:29.576ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109462024-11-14T06:29:29.577ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 185.632285ms iteration = 21 status = 0
109472024-11-14T06:29:29.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109482024-11-14T06:29:29.577ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
109492024-11-14T06:29:29.577ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
109502024-11-14T06:29:29.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109512024-11-14T06:29:29.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109522024-11-14T06:29:29.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 186.232336ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
109532024-11-14T06:29:29.578ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
109542024-11-14T06:29:29.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
109552024-11-14T06:29:29.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109562024-11-14T06:29:29.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109572024-11-14T06:29:29.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109582024-11-14T06:29:29.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109592024-11-14T06:29:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
109602024-11-14T06:29:29.582ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109612024-11-14T06:29:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109622024-11-14T06:29:29.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
109632024-11-14T06:29:29.583ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109642024-11-14T06:29:29.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109652024-11-14T06:29:29.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109662024-11-14T06:29:29.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109672024-11-14T06:29:29.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109682024-11-14T06:29:29.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109692024-11-14T06:29:29.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
109702024-11-14T06:29:29.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109712024-11-14T06:29:29.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109722024-11-14T06:29:29.592ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 30e11b92-f705-4c8e-bce7-d646f8ce00cf dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
109732024-11-14T06:29:29.592ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
109742024-11-14T06:29:29.592ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 06:19:30.340423 UTC dns_group = internal generation = 1
109752024-11-14T06:29:29.592ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 200.131385ms iteration = 12 status = {"generation":1}
109762024-11-14T06:29:29.611ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109772024-11-14T06:29:29.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109782024-11-14T06:29:29.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 220.34059ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
109792024-11-14T06:29:29.621ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
109802024-11-14T06:29:29.621ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109812024-11-14T06:29:29.622ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc48555f-a3ae-47b4-bac5-7a71f22bbf7d", "content-length": "26", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
109822024-11-14T06:29:29.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109832024-11-14T06:29:29.625ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109842024-11-14T06:29:29.625ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
109852024-11-14T06:29:29.633ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109862024-11-14T06:29:29.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109872024-11-14T06:29:29.642ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
109882024-11-14T06:29:29.642ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 0 version = 2
109892024-11-14T06:29:29.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109902024-11-14T06:29:29.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109912024-11-14T06:29:29.643ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109922024-11-14T06:29:29.643ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 0d34574e-3a0d-49bb-b1f1-342637aa0810 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
109932024-11-14T06:29:29.643ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
109942024-11-14T06:29:29.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109952024-11-14T06:29:29.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
109962024-11-14T06:29:29.644ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109972024-11-14T06:29:29.644ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
109982024-11-14T06:29:29.644ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 252.576331ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
109992024-11-14T06:29:29.652ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
110002024-11-14T06:29:29.652ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110012024-11-14T06:29:29.653ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a793dbd9-caca-4091-a07b-60f66a7fda2c", "content-length": "26", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
110022024-11-14T06:29:29.653ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110032024-11-14T06:29:29.656ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
110042024-11-14T06:29:29.656ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T06:19:27.309503Z, time_modified: 2024-11-14T06:19:27.309503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 95153e51-68aa-4bd4-8e65-b8164172811d, db_silo: Silo { identity: SiloIdentity { id: 95153e51-68aa-4bd4-8e65-b8164172811d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T06:19:31.569300Z, time_modified: 2024-11-14T06:19:31.569300Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89" }] }) }
110052024-11-14T06:29:29.656ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 264.384951ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]}},"default_endpoint":{"silo_id":"95153e51-68aa-4bd4-8e65-b8164172811d","tls_certs":["3b4fc5fefb1891d5f9bef719b708b74eebdfa7619e29b8048f95ba7ce50e4b89"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
110062024-11-14T06:29:29.709ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
110072024-11-14T06:29:29.709ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 317.765314ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
110082024-11-14T06:29:29.759ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 367.948178ms iteration = 23 status = {"physical_disks_added":0}
110092024-11-14T06:29:29.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110102024-11-14T06:29:29.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110112024-11-14T06:29:29.778ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
110122024-11-14T06:29:29.778ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f4b07a8-8b35-4fef-a852-e8a1fb2c8bc6", "content-length": "1", "date": "Thu, 14 Nov 2024 06:29:28 GMT"} })
110132024-11-14T06:29:29.779ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110142024-11-14T06:29:29.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110152024-11-14T06:29:29.803ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
110162024-11-14T06:29:29.811ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
110172024-11-14T06:29:29.812ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110182024-11-14T06:29:29.812ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a35aaa4-6d8d-4a12-abe9-d9054cf51673", "content-length": "372", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
110192024-11-14T06:29:29.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110202024-11-14T06:29:29.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110212024-11-14T06:29:29.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110222024-11-14T06:29:29.816ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 424.587672ms iteration = 21 status = null
110232024-11-14T06:29:29.816ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(56a09639-464f-48bf-b120-9ccdf0987326, 0), (feba1a29-4c10-4492-a815-c97085a474b4, 0), (b1d70c97-efc9-4fbd-a649-842759ce153f, 0)]
110242024-11-14T06:29:29.817ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1626, tv_nsec: 375478760 } })
110252024-11-14T06:29:29.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
110262024-11-14T06:29:29.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110272024-11-14T06:29:29.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110282024-11-14T06:29:29.819ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = c6d59938-b455-4e7b-9d17-0d6427a65b9c dns_zone_name = oxide.test found_so_far = 1 version = 2
110292024-11-14T06:29:29.819ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
110302024-11-14T06:29:29.819ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 06:19:31.616543 UTC dns_group = external generation = 2
110312024-11-14T06:29:29.819ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 428.048017ms iteration = 12 status = {"generation":2}
110322024-11-14T06:29:29.833ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
110332024-11-14T06:29:29.834ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f0b53f6c-34ff-4c7c-b3a4-248e6b8ac6f0", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
110342024-11-14T06:29:29.834ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
110352024-11-14T06:29:29.835ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a65160d8-c519-4dca-9f12-99668eb2f078", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
110362024-11-14T06:29:29.835ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
110372024-11-14T06:29:29.837ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
110382024-11-14T06:29:29.837ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 445.431501ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
110392024-11-14T06:29:29.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110402024-11-14T06:29:29.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
110412024-11-14T06:29:29.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110422024-11-14T06:29:29.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110432024-11-14T06:29:29.848ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110442024-11-14T06:29:29.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
110452024-11-14T06:29:29.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110462024-11-14T06:29:29.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110472024-11-14T06:29:29.860ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110482024-11-14T06:29:29.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110492024-11-14T06:29:29.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110502024-11-14T06:29:29.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110512024-11-14T06:29:29.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110522024-11-14T06:29:29.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110532024-11-14T06:29:29.870ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110542024-11-14T06:29:29.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110552024-11-14T06:29:29.875ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
110562024-11-14T06:29:29.875ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
110572024-11-14T06:29:29.875ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "08eeaf46-a750-4056-8076-ac34cc87b4bc", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
110582024-11-14T06:29:29.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110592024-11-14T06:29:29.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110602024-11-14T06:29:29.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110612024-11-14T06:29:29.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110622024-11-14T06:29:29.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110632024-11-14T06:29:29.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110642024-11-14T06:29:29.888ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
110652024-11-14T06:29:29.888ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110662024-11-14T06:29:29.888ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "74da74a7-8aa0-45e7-ab69-d819eda8eff1", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
110672024-11-14T06:29:29.891ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 499.253922ms iteration = 22 status = {}
110682024-11-14T06:29:29.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110692024-11-14T06:29:29.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
110702024-11-14T06:29:29.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110712024-11-14T06:29:29.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110722024-11-14T06:29:29.908ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110732024-11-14T06:29:29.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110742024-11-14T06:29:29.927ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 535.229492ms iteration = 21 status = {}
110752024-11-14T06:29:29.937ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110762024-11-14T06:29:29.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110772024-11-14T06:29:29.939ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110782024-11-14T06:29:29.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
110792024-11-14T06:29:29.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110802024-11-14T06:29:29.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110812024-11-14T06:29:29.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110822024-11-14T06:29:29.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110832024-11-14T06:29:29.946ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
110842024-11-14T06:29:29.946ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
110852024-11-14T06:29:29.946ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
110862024-11-14T06:29:29.947ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "84ff7ae8-88bf-416f-87a6-6de8288f2953", "content-length": "476", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
110872024-11-14T06:29:29.947ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
110882024-11-14T06:29:29.947ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "16cdabe4-b48b-4a57-8503-526a90c725dc", "content-length": "734", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
110892024-11-14T06:29:29.947ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
110902024-11-14T06:29:29.947ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdc0d4e6-5bb2-4220-bb6c-a64a6e9ece88", "content-length": "111", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
110912024-11-14T06:29:29.947ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
110922024-11-14T06:29:29.947ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110932024-11-14T06:29:29.948ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "467a0c2e-502e-40ec-bb4b-141aafc0c954", "content-length": "111", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
110942024-11-14T06:29:29.948ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
110952024-11-14T06:29:29.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110962024-11-14T06:29:29.948ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c512821f-2d33-4f25-ab7f-d8432cb948ab", "content-length": "167", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
110972024-11-14T06:29:29.948ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
110982024-11-14T06:29:29.948ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "db66020d-55a6-442e-b085-ec71375c6fb3", "content-length": "167", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
110992024-11-14T06:29:29.948ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
111002024-11-14T06:29:29.948ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c05880d-f9ea-45f5-8a90-d4bef4337a2b", "content-length": "175", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111012024-11-14T06:29:29.948ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
111022024-11-14T06:29:29.949ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e170c9f-15fc-41a0-a6a3-8df11ca83c99", "content-length": "175", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111032024-11-14T06:29:29.949ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
111042024-11-14T06:29:29.949ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e380466c-59b9-41e5-8769-9b5ed9e6c9a8", "content-length": "702", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111052024-11-14T06:29:29.949ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
111062024-11-14T06:29:29.949ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9857863d-9219-4e59-8e4d-4c9c0e0bda3a", "content-length": "727", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111072024-11-14T06:29:29.949ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
111082024-11-14T06:29:29.949ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6eee83ea-bc15-461b-9693-765646f7536b", "content-length": "729", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111092024-11-14T06:29:29.949ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
111102024-11-14T06:29:29.949ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "68bc2eb5-c5b4-4a71-9efe-2e41321309f9", "content-length": "728", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111112024-11-14T06:29:29.949ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
111122024-11-14T06:29:29.949ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "116b9a12-e71b-4cc1-a1c0-cc723fa7594d", "content-length": "722", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111132024-11-14T06:29:29.950ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
111142024-11-14T06:29:29.950ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d25a409-697d-45f0-a06f-2c2ea36026be", "content-length": "109", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111152024-11-14T06:29:29.950ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
111162024-11-14T06:29:29.950ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111172024-11-14T06:29:29.950ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "795ed434-f50f-4e8d-b69f-4cecbe6a7be1", "content-length": "109", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111182024-11-14T06:29:29.950ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
111192024-11-14T06:29:29.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111202024-11-14T06:29:29.950ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "00f74501-1cb3-4d70-960c-514513e557ff", "content-length": "169", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111212024-11-14T06:29:29.950ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
111222024-11-14T06:29:29.951ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae7c5cfb-cf50-4c96-908c-a674dfd3ecbd", "content-length": "169", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111232024-11-14T06:29:29.951ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
111242024-11-14T06:29:29.951ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4499073d-67ae-4713-98cd-1efb4e09abbc", "content-length": "178", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111252024-11-14T06:29:29.951ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
111262024-11-14T06:29:29.951ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "63d1a573-80ff-419b-b7a0-daefe8509c34", "content-length": "178", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111272024-11-14T06:29:29.951ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
111282024-11-14T06:29:29.951ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bcb3ac7-d07a-4045-ac14-45806b5181f5", "content-length": "702", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111292024-11-14T06:29:29.951ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
111302024-11-14T06:29:29.951ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c72414b0-563e-4c8f-825d-9c473cf954c1", "content-length": "727", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111312024-11-14T06:29:29.951ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
111322024-11-14T06:29:29.952ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dcc1b7f-2f66-4020-89f8-dbe7dc280d8c", "content-length": "729", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111332024-11-14T06:29:29.952ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
111342024-11-14T06:29:29.952ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b565c0ee-98cd-4748-985d-720064ec7241", "content-length": "728", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111352024-11-14T06:29:29.952ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111362024-11-14T06:29:29.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111372024-11-14T06:29:29.953ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111382024-11-14T06:29:29.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111392024-11-14T06:29:29.955ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111402024-11-14T06:29:29.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111412024-11-14T06:29:29.956ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111422024-11-14T06:29:29.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111432024-11-14T06:29:29.962ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
111442024-11-14T06:29:29.963ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1b37a8a3-8810-47be-bbff-79852d4499b2", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
111452024-11-14T06:29:29.963ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
111462024-11-14T06:29:29.966ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4909f98f-72e9-4799-a618-ab86c61da596", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
111472024-11-14T06:29:29.966ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
111482024-11-14T06:29:29.967ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ea7ca8de-871c-4df6-932f-8828987d6bfa", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
111492024-11-14T06:29:29.967ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
111502024-11-14T06:29:29.969ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
111512024-11-14T06:29:29.969ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 577.404816ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
111522024-11-14T06:29:29.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111532024-11-14T06:29:29.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111542024-11-14T06:29:29.991ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111552024-11-14T06:29:29.991ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
111562024-11-14T06:29:29.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111572024-11-14T06:29:29.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111582024-11-14T06:29:29.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
111592024-11-14T06:29:29.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111602024-11-14T06:29:29.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111612024-11-14T06:29:29.995ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111622024-11-14T06:29:29.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
111632024-11-14T06:29:29.996ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111642024-11-14T06:29:29.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111652024-11-14T06:29:30.001ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
111662024-11-14T06:29:30.002ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d8aac68-85ba-4cda-89d7-bb5400923d01", "content-length": "134", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111672024-11-14T06:29:30.002ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
111682024-11-14T06:29:30.002ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
111692024-11-14T06:29:30.002ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
111702024-11-14T06:29:30.002ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
111712024-11-14T06:29:30.002ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111722024-11-14T06:29:30.002ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111732024-11-14T06:29:30.002ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111742024-11-14T06:29:30.002ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
111752024-11-14T06:29:30.002ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111762024-11-14T06:29:30.002ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
111772024-11-14T06:29:30.002ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
111782024-11-14T06:29:30.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111792024-11-14T06:29:30.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111802024-11-14T06:29:30.011ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
111812024-11-14T06:29:30.011ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "315653c0-875b-47f3-bca3-393ba52433de", "content-length": "691", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111822024-11-14T06:29:30.011ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
111832024-11-14T06:29:30.011ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
111842024-11-14T06:29:30.011ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
111852024-11-14T06:29:30.012ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 620.653212ms iteration = 21 status = {}
111862024-11-14T06:29:30.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111872024-11-14T06:29:30.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111882024-11-14T06:29:30.013ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111892024-11-14T06:29:30.013ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
111902024-11-14T06:29:30.014ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d66c8462-c5a2-4e11-a644-dd1b87a8df89", "content-length": "2", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111912024-11-14T06:29:30.014ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
111922024-11-14T06:29:30.014ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5584e8a4-47a1-42f3-88a8-03d96b017b85", "content-length": "52", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
111932024-11-14T06:29:30.014ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
111942024-11-14T06:29:30.014ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
111952024-11-14T06:29:30.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
111962024-11-14T06:29:30.015ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111972024-11-14T06:29:30.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111982024-11-14T06:29:30.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111992024-11-14T06:29:30.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112002024-11-14T06:29:30.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112012024-11-14T06:29:30.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
112022024-11-14T06:29:30.061ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112032024-11-14T06:29:30.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112042024-11-14T06:29:30.067ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112052024-11-14T06:29:30.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112062024-11-14T06:29:30.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112072024-11-14T06:29:30.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112082024-11-14T06:29:30.071ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112092024-11-14T06:29:30.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112102024-11-14T06:29:30.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112112024-11-14T06:29:30.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112122024-11-14T06:29:30.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112132024-11-14T06:29:30.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112142024-11-14T06:29:30.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112152024-11-14T06:29:30.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112162024-11-14T06:29:30.129ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
112172024-11-14T06:29:30.129ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
112182024-11-14T06:29:30.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112192024-11-14T06:29:30.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112202024-11-14T06:29:30.150ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "235b3a0c-c897-4bf9-b91f-66843de01563", "date": "Thu, 14 Nov 2024 06:29:29 GMT"} })
112212024-11-14T06:29:30.150ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
112222024-11-14T06:29:30.150ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
112232024-11-14T06:29:30.156ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e3afcc7-d91f-4dbf-8248-b4d4ee1a6d48", "content-length": "682", "date": "Thu, 14 Nov 2024 06:29:30 GMT"} })
112242024-11-14T06:29:30.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112252024-11-14T06:29:30.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112262024-11-14T06:29:30.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112272024-11-14T06:29:30.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112282024-11-14T06:29:30.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112292024-11-14T06:29:30.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
112302024-11-14T06:29:30.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112312024-11-14T06:29:30.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112322024-11-14T06:29:30.164ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112332024-11-14T06:29:30.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112342024-11-14T06:29:30.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112352024-11-14T06:29:30.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112362024-11-14T06:29:30.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112372024-11-14T06:29:30.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112382024-11-14T06:29:30.174ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 782.774929ms iteration = 21 status = {}
112392024-11-14T06:29:30.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112402024-11-14T06:29:30.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112412024-11-14T06:29:30.197ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112422024-11-14T06:29:30.200ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
112432024-11-14T06:29:30.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112442024-11-14T06:29:30.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112452024-11-14T06:29:30.211ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
112462024-11-14T06:29:30.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112472024-11-14T06:29:30.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112482024-11-14T06:29:30.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112492024-11-14T06:29:30.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
112502024-11-14T06:29:30.214ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112512024-11-14T06:29:30.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112522024-11-14T06:29:30.217ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
112532024-11-14T06:29:30.217ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 015932fe-ddf2-4239-b1fd-e7424a4040be, kind: Service { id: f40de7f6-4bc1-4578-baeb-b08e777b4bed }, name: Name("external-dns-f40de7f6-4bc1-4578-baeb-b08e777b4bed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 243])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0e6ae03a-a5e3-484d-8e1e-e705408292b1, kind: Service { id: 720ac48b-8596-4763-a661-482d124c0a16 }, name: Name("external-dns-720ac48b-8596-4763-a661-482d124c0a16"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 194])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 44b33ba4-d228-461a-936e-500ecd8234e8, kind: Service { id: 6e81a29a-9566-4f30-8c2b-046fbbd99dfa }, name: Name("nexus-6e81a29a-9566-4f30-8c2b-046fbbd99dfa"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 136])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 916a8c66-d641-42bc-8af2-c47fc40ac221, kind: Service { id: 80190dc3-d884-49a0-b9a3-38d31e8c655a }, name: Name("nexus-80190dc3-d884-49a0-b9a3-38d31e8c655a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a40ff81-4129-4ebe-8b5e-aa7b0c0227b9, kind: Service { id: b8f86511-dd51-4fcd-bfdc-8e92264988b6 }, name: Name("nexus-b8f86511-dd51-4fcd-bfdc-8e92264988b6"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
112542024-11-14T06:29:30.217ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
112552024-11-14T06:29:30.345ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, time_created: 2024-11-14T06:19:28.463914Z, time_modified: 2024-11-14T06:19:28.463914Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
112562024-11-14T06:29:30.345ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
112572024-11-14T06:29:30.345ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112582024-11-14T06:29:30.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112592024-11-14T06:29:30.347ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112602024-11-14T06:29:30.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112612024-11-14T06:29:30.349ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112622024-11-14T06:29:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
112632024-11-14T06:29:30.382ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
112642024-11-14T06:29:30.392ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "4e210eca-56d3-4827-8151-52e4d6952006", "date": "Thu, 14 Nov 2024 06:29:30 GMT"} })
112652024-11-14T06:29:30.393ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
112662024-11-14T06:29:30.393ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 1.001324467s
112672024-11-14T06:29:30.393ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 1.001333638s iteration = 3 status = {}
112682024-11-14T06:29:30.527ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0806825-fb64-492d-975d-708f680b5632", "content-length": "30760", "date": "Thu, 14 Nov 2024 06:29:30 GMT"} })
112692024-11-14T06:29:30.529ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
112702024-11-14T06:29:30.529ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
112712024-11-14T06:29:30.529ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
112722024-11-14T06:29:30.531ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112732024-11-14T06:29:30.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112742024-11-14T06:29:30.533ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112752024-11-14T06:29:30.534ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
112762024-11-14T06:29:30.534ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112772024-11-14T06:29:30.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112782024-11-14T06:29:30.711ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 93a9bec0-9d92-4b09-a8c0-d42e1d559973 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
112792024-11-14T06:29:30.711ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 93a9bec0-9d92-4b09-a8c0-d42e1d559973 time_started = 2024-11-14 06:29:29.946919 UTC
112802024-11-14T06:29:30.711ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.319417628s iteration = 3 status = {"collection_id":"93a9bec0-9d92-4b09-a8c0-d42e1d559973","time_done":"2024-11-14 06:29:30.529609 UTC","time_started":"2024-11-14 06:29:29.946919 UTC"}
112812024-11-14T06:29:30.711ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
112822024-11-14T06:29:30.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112832024-11-14T06:29:30.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112842024-11-14T06:29:30.712ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112852024-11-14T06:29:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112862024-11-14T06:29:30.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112872024-11-14T06:29:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112882024-11-14T06:29:30.716ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112892024-11-14T06:29:30.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112902024-11-14T06:29:30.718ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112912024-11-14T06:29:30.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112922024-11-14T06:29:30.720ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112932024-11-14T06:29:30.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112942024-11-14T06:29:30.742ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 31.273842ms iteration = 24 status = {"physical_disks_added":0}
112952024-11-14T06:29:33.568ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
112962024-11-14T06:29:33.568ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
112972024-11-14T06:29:33.598ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
112982024-11-14T06:29:33.598ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:55622
112992024-11-14T06:29:33.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55622 req_id = 76e37ff1-303b-4948-a8fe-97b1d14419d0 roles = RoleSet { roles: {} } uri = /metrics/producers
113002024-11-14T06:29:33.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55622 req_id = 76e37ff1-303b-4948-a8fe-97b1d14419d0 resource = Database result = Ok(()) uri = /metrics/producers
113012024-11-14T06:29:33.632ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 6e81a29a-9566-4f30-8c2b-046fbbd99dfa
113022024-11-14T06:29:33.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34103 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:55622 req_id = 76e37ff1-303b-4948-a8fe-97b1d14419d0 response_code = 201 uri = /metrics/producers
113032024-11-14T06:29:33.633ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "76e37ff1-303b-4948-a8fe-97b1d14419d0", "content-length": "41", "date": "Thu, 14 Nov 2024 06:29:33 GMT"} })
113042024-11-14T06:29:33.634ZDEBGnexus (producer-registration-task): registered with nexus successfully
113052024-11-14T06:29:33.634ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
113062024-11-14T06:29:37.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1565 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 6a840bcf-7b3c-41b5-b5da-f3611e7c03b9 response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
113072024-11-14T06:29:39.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
113082024-11-14T06:29:39.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
113092024-11-14T06:29:39.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113102024-11-14T06:29:39.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113112024-11-14T06:29:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113122024-11-14T06:29:39.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113132024-11-14T06:29:39.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113142024-11-14T06:29:39.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113152024-11-14T06:29:39.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113162024-11-14T06:29:39.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113172024-11-14T06:29:39.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113182024-11-14T06:29:39.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113192024-11-14T06:29:39.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113202024-11-14T06:29:39.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
113212024-11-14T06:29:39.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113222024-11-14T06:29:39.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113232024-11-14T06:29:39.412ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
113242024-11-14T06:29:39.412ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.583581ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
113252024-11-14T06:29:39.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113262024-11-14T06:29:39.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113272024-11-14T06:29:39.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.188339ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113282024-11-14T06:29:45.060ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:43448
113292024-11-14T06:29:45.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43448 req_id = bc3081a4-c408-4ea4-94fb-780e911891e6 roles = RoleSet { roles: {} } uri = /metrics/producers
113302024-11-14T06:29:45.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43448 req_id = bc3081a4-c408-4ea4-94fb-780e911891e6 resource = Database result = Ok(()) uri = /metrics/producers
113312024-11-14T06:29:45.096ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 27a56cb4-44ff-4d5b-931e-1c2c0642844d
113322024-11-14T06:29:45.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36156 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43448 req_id = bc3081a4-c408-4ea4-94fb-780e911891e6 response_code = 201 uri = /metrics/producers
113332024-11-14T06:29:49.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
113342024-11-14T06:29:49.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113352024-11-14T06:29:49.391ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
113362024-11-14T06:29:49.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113372024-11-14T06:29:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113382024-11-14T06:29:49.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113392024-11-14T06:29:49.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113402024-11-14T06:29:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113412024-11-14T06:29:49.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113422024-11-14T06:29:49.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113432024-11-14T06:29:49.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113442024-11-14T06:29:49.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113452024-11-14T06:29:49.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113462024-11-14T06:29:49.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
113472024-11-14T06:29:49.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113482024-11-14T06:29:49.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113492024-11-14T06:29:49.415ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
113502024-11-14T06:29:49.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.600319ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
113512024-11-14T06:29:49.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113522024-11-14T06:29:49.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113532024-11-14T06:29:49.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.064812ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113542024-11-14T06:29:51.581ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52676
113552024-11-14T06:29:51.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52676 req_id = 7c7cd0c2-10f7-4e46-81bb-f7458bb1fd75 roles = RoleSet { roles: {} } uri = /metrics/producers
113562024-11-14T06:29:51.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52676 req_id = 7c7cd0c2-10f7-4e46-81bb-f7458bb1fd75 resource = Database result = Ok(()) uri = /metrics/producers
113572024-11-14T06:29:51.591ZINFOnexus: assigned collector to new producer collector_id = d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6 file = nexus/src/app/oximeter.rs:76 producer_id = 914339bb-5810-4f30-ae08-365f08250a83
113582024-11-14T06:29:51.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10071 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52676 req_id = 7c7cd0c2-10f7-4e46-81bb-f7458bb1fd75 response_code = 201 uri = /metrics/producers
113592024-11-14T06:29:52.606ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1224 local_addr = [fd00:1122:3344:101::b]:50471 method = GET remote_addr = [fd00:1122:3344:101::d]:51900 req_id = 35bd7115-41c4-49b6-bed7-ea037ba7f89a response_code = 200 uri = /6e81a29a-9566-4f30-8c2b-046fbbd99dfa
113602024-11-14T06:29:57.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 60890ab3-dfad-4536-a3d2-23aae82f592c roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
113612024-11-14T06:29:57.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 60890ab3-dfad-4536-a3d2-23aae82f592c resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
113622024-11-14T06:29:57.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = 60890ab3-dfad-4536-a3d2-23aae82f592c response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?sort_by=id_ascending
113632024-11-14T06:29:57.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = a0dd7cac-368a-4824-aa29-a79dd29d0767 roles = RoleSet { roles: {} } uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
113642024-11-14T06:29:57.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = a0dd7cac-368a-4824-aa29-a79dd29d0767 resource = Database result = Ok(()) uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
113652024-11-14T06:29:57.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40729 req_id = a0dd7cac-368a-4824-aa29-a79dd29d0767 response_code = 200 uri = /metrics/collectors/d02ec3ee-b3b0-4f1a-9803-877dc8b1dea6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmOWMwNjg3MC1lNTFmLTQzYWUtODQyZS0xZmI3OGY3OThmNDEifX0%3D
113662024-11-14T06:29:59.391ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
113672024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113682024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
113692024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
113702024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113712024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
113722024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
113732024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
113742024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113752024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113762024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
113772024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
113782024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
113792024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113802024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
113812024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
113822024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113832024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
113842024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
113852024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
113862024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113872024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
113882024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113892024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
113902024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
113912024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
113922024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113932024-11-14T06:29:59.392ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
113942024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
113952024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
113962024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
113972024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113982024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
113992024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114002024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114012024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114022024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
114032024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114042024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114052024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114062024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
114072024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
114082024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
114092024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114102024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114112024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114122024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114132024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114142024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114152024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114162024-11-14T06:29:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
114172024-11-14T06:29:59.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114182024-11-14T06:29:59.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114192024-11-14T06:29:59.396ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1655, tv_nsec: 954339672 } })
114202024-11-14T06:29:59.396ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114212024-11-14T06:29:59.396ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.237859ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
114222024-11-14T06:29:59.396ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
114232024-11-14T06:29:59.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114242024-11-14T06:29:59.398ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1655, tv_nsec: 956705726 } })
114252024-11-14T06:29:59.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
114262024-11-14T06:29:59.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114272024-11-14T06:29:59.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114282024-11-14T06:29:59.398ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
114292024-11-14T06:29:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
114302024-11-14T06:29:59.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114312024-11-14T06:29:59.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114322024-11-14T06:29:59.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114332024-11-14T06:29:59.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114342024-11-14T06:29:59.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114352024-11-14T06:29:59.403ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114362024-11-14T06:29:59.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114372024-11-14T06:29:59.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114382024-11-14T06:29:59.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114392024-11-14T06:29:59.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114402024-11-14T06:29:59.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114412024-11-14T06:29:59.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114422024-11-14T06:29:59.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114432024-11-14T06:29:59.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114442024-11-14T06:29:59.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114452024-11-14T06:29:59.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114462024-11-14T06:29:59.414ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-27a56cb4-44ff-4d5b-931e-1c2c0642844d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1655, tv_nsec: 972207795 } })
114472024-11-14T06:29:59.414ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
114482024-11-14T06:29:59.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114492024-11-14T06:29:59.418ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114502024-11-14T06:29:59.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114512024-11-14T06:29:59.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114522024-11-14T06:29:59.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1d98d624-72d4-4466-8fe7-990461a3f886, lookup_type: ById(1d98d624-72d4-4466-8fe7-990461a3f886) } result = Ok(())
114532024-11-14T06:29:59.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114542024-11-14T06:29:59.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114552024-11-14T06:29:59.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114562024-11-14T06:29:59.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114572024-11-14T06:29:59.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114582024-11-14T06:29:59.439ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 original_time_created = 2024-11-14 06:19:20.528165 UTC target_id = 1d98d624-72d4-4466-8fe7-990461a3f886 time_created = 2024-11-14 06:19:20.528165 UTC
114592024-11-14T06:29:59.439ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.652497ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1d98d624-72d4-4466-8fe7-990461a3f886","time_created":"2024-11-14T06:19:20.528165Z"}
114602024-11-14T06:29:59.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.172134ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
114612024-11-14T06:29:59.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.845592ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
114622024-11-14T06:29:59.450ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
114632024-11-14T06:29:59.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114642024-11-14T06:29:59.453ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114652024-11-14T06:29:59.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
114662024-11-14T06:29:59.463ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114672024-11-14T06:29:59.465ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114682024-11-14T06:29:59.465ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
114692024-11-14T06:29:59.465ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114702024-11-14T06:29:59.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114712024-11-14T06:29:59.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
114722024-11-14T06:29:59.467ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114732024-11-14T06:29:59.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114742024-11-14T06:29:59.468ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114752024-11-14T06:29:59.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114762024-11-14T06:29:59.470ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114772024-11-14T06:29:59.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114782024-11-14T06:29:59.473ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.67349ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114792024-11-14T06:29:59.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114802024-11-14T06:29:59.475ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114812024-11-14T06:29:59.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114822024-11-14T06:29:59.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114832024-11-14T06:29:59.487ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
114842024-11-14T06:29:59.487ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.515928ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
114852024-11-14T06:29:59.491ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
114862024-11-14T06:29:59.491ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114872024-11-14T06:29:59.492ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dedf585-29a8-4b50-9334-132db626d645", "content-length": "26", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
114882024-11-14T06:29:59.492ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114892024-11-14T06:29:59.493ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114902024-11-14T06:29:59.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.630796ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
114912024-11-14T06:29:59.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114922024-11-14T06:29:59.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114932024-11-14T06:29:59.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114942024-11-14T06:29:59.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114952024-11-14T06:29:59.505ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114962024-11-14T06:29:59.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114972024-11-14T06:29:59.507ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.101712ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
114982024-11-14T06:29:59.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114992024-11-14T06:29:59.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 27a56cb4-44ff-4d5b-931e-1c2c0642844d, lookup_type: ById(27a56cb4-44ff-4d5b-931e-1c2c0642844d) } result = Ok(())
115002024-11-14T06:29:59.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115012024-11-14T06:29:59.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115022024-11-14T06:29:59.513ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.074943ms iteration = 22 status = 0
115032024-11-14T06:29:59.516ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115042024-11-14T06:29:59.516ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
115052024-11-14T06:29:59.516ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115062024-11-14T06:29:59.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115072024-11-14T06:29:59.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 149.698866ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
115082024-11-14T06:29:59.553ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115092024-11-14T06:29:59.553ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
115102024-11-14T06:29:59.553ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 161.315063ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
115112024-11-14T06:29:59.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115122024-11-14T06:29:59.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115132024-11-14T06:29:59.560ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.558837ms iteration = 25 status = {"physical_disks_added":0}
115142024-11-14T06:29:59.589ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
115152024-11-14T06:29:59.589ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1e9f125-6898-42bd-af03-ca262f41b275", "content-length": "1", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
115162024-11-14T06:29:59.592ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115172024-11-14T06:29:59.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115182024-11-14T06:29:59.602ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
115192024-11-14T06:29:59.602ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115202024-11-14T06:29:59.602ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cee2c055-3e90-4261-8c4d-3e5f5d260104", "content-length": "26", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
115212024-11-14T06:29:59.602ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115222024-11-14T06:29:59.604ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
115232024-11-14T06:29:59.615ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 zone_address = fd00:1122:3344:101::2
115242024-11-14T06:29:59.615ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115252024-11-14T06:29:59.615ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "89c0f042-eaa0-4f0b-9072-02afc45d8414", "content-length": "26", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
115262024-11-14T06:29:59.616ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115272024-11-14T06:29:59.617ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
115282024-11-14T06:29:59.670ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
115292024-11-14T06:29:59.670ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115302024-11-14T06:29:59.670ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfb24b95-0dc1-484d-8697-5738b09659f5", "content-length": "372", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
115312024-11-14T06:29:59.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115322024-11-14T06:29:59.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115332024-11-14T06:29:59.672ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 280.215006ms iteration = 22 status = null
115342024-11-14T06:29:59.672ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115352024-11-14T06:29:59.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115362024-11-14T06:29:59.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115372024-11-14T06:29:59.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
115382024-11-14T06:29:59.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115392024-11-14T06:29:59.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115402024-11-14T06:29:59.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115412024-11-14T06:29:59.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
115422024-11-14T06:29:59.682ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115432024-11-14T06:29:59.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115442024-11-14T06:29:59.691ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 299.476763ms iteration = 22 status = {}
115452024-11-14T06:29:59.715ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
115462024-11-14T06:29:59.715ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
115472024-11-14T06:29:59.716ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "239c6116-a0d5-4155-9103-b11099bd57e5", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
115482024-11-14T06:29:59.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115492024-11-14T06:29:59.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115502024-11-14T06:29:59.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115512024-11-14T06:29:59.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115522024-11-14T06:29:59.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115532024-11-14T06:29:59.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115542024-11-14T06:29:59.727ZINFOnexus (BackgroundTasks): VPC route manager sled 27a56cb4-44ff-4d5b-931e-1c2c0642844d push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
115552024-11-14T06:29:59.727ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115562024-11-14T06:29:59.727ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e988bc30-e748-4cc7-a578-440b452156df", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
115572024-11-14T06:29:59.729ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 337.43715ms iteration = 23 status = {}
115582024-11-14T06:29:59.756ZDEBGnexus (BackgroundTasks): client request SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
115592024-11-14T06:29:59.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115602024-11-14T06:29:59.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115612024-11-14T06:29:59.798ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: cecfafa4-4697-4aa6-949f-23c34aa9d5bd, rack_id: f391bffc-9f2b-4c87-85cd-2718afa7cb93, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(58c91208-be0a-4936-a7c2-2ae07694e16d) } rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
115622024-11-14T06:29:59.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115632024-11-14T06:29:59.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115642024-11-14T06:29:59.809ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
115652024-11-14T06:29:59.809ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "02e40987-0e75-4f9f-9a56-45c38f72cdbd", "content-length": "134", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
115662024-11-14T06:29:59.809ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
115672024-11-14T06:29:59.809ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 58c91208-be0a-4936-a7c2-2ae07694e16d
115682024-11-14T06:29:59.809ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
115692024-11-14T06:29:59.809ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
115702024-11-14T06:29:59.809ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115712024-11-14T06:29:59.809ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115722024-11-14T06:29:59.809ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115732024-11-14T06:29:59.809ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115742024-11-14T06:29:59.810ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115752024-11-14T06:29:59.810ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115762024-11-14T06:29:59.810ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93
115772024-11-14T06:29:59.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115782024-11-14T06:29:59.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115792024-11-14T06:29:59.813ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
115802024-11-14T06:29:59.813ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6296754c-1893-438c-9b22-7a537aae41a8", "content-length": "2", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
115812024-11-14T06:29:59.813ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
115822024-11-14T06:29:59.813ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "587db476-a006-4631-851a-1f5544875e72", "content-length": "52", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
115832024-11-14T06:29:59.813ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch_location = Switch0
115842024-11-14T06:29:59.813ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
115852024-11-14T06:29:59.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 27a56cb4-44ff-4d5b-931e-1c2c0642844d background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "15dfab93-2084-47fb-839c-d8946deabe71", "content-length": "691", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
115862024-11-14T06:29:59.859ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
115872024-11-14T06:29:59.859ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
115882024-11-14T06:29:59.859ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
115892024-11-14T06:29:59.861ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 468.943218ms iteration = 22 status = {}
115902024-11-14T06:29:59.949ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "79b57967-e423-4ba1-a89a-bd0542932083", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
115912024-11-14T06:29:59.949ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 switch = Switch0
115922024-11-14T06:29:59.949ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
115932024-11-14T06:29:59.955ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f391bffc-9f2b-4c87-85cd-2718afa7cb93 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "560a6c8e-e2d2-41a5-adce-e188ff21b884", "content-length": "682", "date": "Thu, 14 Nov 2024 06:29:59 GMT"} })
115942024-11-14T06:29:59.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115952024-11-14T06:29:59.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115962024-11-14T06:29:59.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115972024-11-14T06:29:59.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115982024-11-14T06:29:59.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115992024-11-14T06:29:59.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116002024-11-14T06:29:59.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116012024-11-14T06:29:59.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116022024-11-14T06:29:59.972ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 580.608897ms iteration = 22 status = {}