Max level shown:
1 [ Nov 25 19:31:01 Enabled. ]
2 [ Nov 25 19:31:01 Rereading configuration. ]
3 [ Nov 25 19:31:04 Rereading configuration. ]
4 [ Nov 25 19:31:14 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Nov 25 19:31:14 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-11-25T19:31:14.332ZDEBGnexus: registered DTrace probes
82024-11-25T19:31:14.334ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:75
92024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-11-25T19:31:14.343ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-11-25T19:31:14.343ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-11-25T19:31:14.362ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-11-25T19:31:14.365ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-11-25T19:31:14.369ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-11-25T19:31:14.377ZDEBGnexus (ServerContext): registered USDT probes
672024-11-25T19:31:14.413ZINFOnexus: Database schema version is up to date desired_version = 114.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 114.0.0
682024-11-25T19:31:14.416ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1099, tv_nsec: 965351156 } })
692024-11-25T19:31:14.416ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
702024-11-25T19:31:14.418ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
712024-11-25T19:31:14.471ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
722024-11-25T19:31:14.471ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-11-25T19:31:14.475ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "20d9c2cd-0ef1-48dd-88f1-86518f92e71f", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:14 GMT"} })
742024-11-25T19:31:14.475ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-11-25T19:31:14.475ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-11-25T19:31:14.513ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1100, tv_nsec: 62311558 } })
772024-11-25T19:31:14.514ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
782024-11-25T19:31:14.547ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
792024-11-25T19:31:14.547ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-11-25T19:31:14.548ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "113d4704-afd1-443f-bb9a-34d4f0c5628a", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:14 GMT"} })
812024-11-25T19:31:14.548ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-11-25T19:31:14.548ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-11-25T19:31:14.622ZDEBGnexus (clickhouse-client): registered USDT probes id = 390459f9-9e08-4035-994b-326022c1b927
842024-11-25T19:31:14.641ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
852024-11-25T19:31:14.660ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
862024-11-25T19:31:14.661ZDEBGnexus (DataLoader): attempting to create built-in users
872024-11-25T19:31:14.661ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
882024-11-25T19:31:14.662ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
892024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
902024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks versions = all
912024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate versions = all
922024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
932024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /clickhouse/policy versions = all
942024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /clickhouse/policy versions = all
952024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
962024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
972024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
982024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
992024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1002024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga versions = all
1012024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1022024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all versions = all
1032024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1042024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1052024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import versions = all
1062024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1072024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target versions = all
1082024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target versions = all
1092024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1102024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1112024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id} versions = all
1122024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1132024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors versions = all
1142024-11-25T19:31:14.686ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1152024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers versions = all
1162024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1172024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge versions = all
1182024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled} versions = all
1192024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1202024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas versions = all
1212024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id} versions = all
1222024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1232024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1242024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1252024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add versions = all
1262024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge versions = all
1272024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized versions = all
1282024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id} versions = all
1292024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1302024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1312024-11-25T19:31:14.687ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:12221
1322024-11-25T19:31:14.687ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1332024-11-25T19:31:14.687ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1342024-11-25T19:31:14.688ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1352024-11-25T19:31:14.720ZWARNnexus: Cannot look up rack: Object (of type ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c)) not found: rack file = nexus/src/app/rack.rs:774
1362024-11-25T19:31:14.729ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1372024-11-25T19:31:14.729ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1382024-11-25T19:31:14.731ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1392024-11-25T19:31:14.731ZDEBGnexus (DataLoader): attempting to create built-in roles
1402024-11-25T19:31:14.731ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1412024-11-25T19:31:14.731ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1422024-11-25T19:31:14.744ZINFOnexus (DataLoader): created 10 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1432024-11-25T19:31:14.744ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1442024-11-25T19:31:14.746ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1452024-11-25T19:31:14.746ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1462024-11-25T19:31:14.746ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1472024-11-25T19:31:14.747ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1482024-11-25T19:31:14.997ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:33420
1492024-11-25T19:31:15.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 3c47d5a2-bfff-48f3-a063-ac481a76e992 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
1502024-11-25T19:31:15.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 3c47d5a2-bfff-48f3-a063-ac481a76e992 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
1512024-11-25T19:31:15.272ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1522024-11-25T19:31:15.272ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1532024-11-25T19:31:15.274ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1542024-11-25T19:31:15.274ZDEBGnexus (DataLoader): attempting to create built-in silos
1552024-11-25T19:31:15.274ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1562024-11-25T19:31:15.274ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1572024-11-25T19:31:15.362ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1582024-11-25T19:31:15.362ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1592024-11-25T19:31:15.362ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1602024-11-25T19:31:15.374ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1612024-11-25T19:31:15.375ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1622024-11-25T19:31:15.375ZDEBGnexus (DataLoader): attempting to create built-in projects
1632024-11-25T19:31:15.375ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-11-25T19:31:15.375ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-11-25T19:31:15.392ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1662024-11-25T19:31:15.392ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1672024-11-25T19:31:15.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 3c47d5a2-bfff-48f3-a063-ac481a76e992 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
1682024-11-25T19:31:15.577ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692024-11-25T19:31:15.577ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1702024-11-25T19:31:15.578ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 3c47d5a2-bfff-48f3-a063-ac481a76e992 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
1712024-11-25T19:31:15.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 3c47d5a2-bfff-48f3-a063-ac481a76e992 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
1722024-11-25T19:31:15.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 3c47d5a2-bfff-48f3-a063-ac481a76e992 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
1732024-11-25T19:31:15.608ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-11-25T19:31:15.610ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1752024-11-25T19:31:15.610ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1762024-11-25T19:31:15.610ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1772024-11-25T19:31:15.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 3c47d5a2-bfff-48f3-a063-ac481a76e992 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
1782024-11-25T19:31:15.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 3c47d5a2-bfff-48f3-a063-ac481a76e992 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
1792024-11-25T19:31:15.641ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1802024-11-25T19:31:15.642ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1812024-11-25T19:31:15.643ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1822024-11-25T19:31:15.646ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1832024-11-25T19:31:15.646ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1842024-11-25T19:31:15.646ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1852024-11-25T19:31:15.682ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 3c47d5a2-bfff-48f3-a063-ac481a76e992 setting = cluster.preserve_downgrade_option uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete value = 22.1
1862024-11-25T19:31:15.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 3c47d5a2-bfff-48f3-a063-ac481a76e992 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
1872024-11-25T19:31:15.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 3c47d5a2-bfff-48f3-a063-ac481a76e992 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
1882024-11-25T19:31:15.689ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c" error_message_internal = not found: rack with id "bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 691854 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 3c47d5a2-bfff-48f3-a063-ac481a76e992 response_code = 404 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
1892024-11-25T19:31:15.744ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1902024-11-25T19:31:15.744ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912024-11-25T19:31:15.745ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1922024-11-25T19:31:15.745ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1932024-11-25T19:31:15.745ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942024-11-25T19:31:15.745ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952024-11-25T19:31:15.751ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962024-11-25T19:31:15.751ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972024-11-25T19:31:15.756ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1982024-11-25T19:31:15.756ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1992024-11-25T19:31:15.759ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002024-11-25T19:31:15.759ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2012024-11-25T19:31:15.760ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022024-11-25T19:31:15.761ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032024-11-25T19:31:16.028ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042024-11-25T19:31:16.030ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2052024-11-25T19:31:16.031ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062024-11-25T19:31:16.031ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2072024-11-25T19:31:16.065ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082024-11-25T19:31:16.065ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092024-11-25T19:31:16.066ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102024-11-25T19:31:16.066ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2112024-11-25T19:31:16.068ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122024-11-25T19:31:16.070ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2132024-11-25T19:31:16.070ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142024-11-25T19:31:16.070ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2152024-11-25T19:31:16.126ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162024-11-25T19:31:16.126ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172024-11-25T19:31:16.127ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182024-11-25T19:31:16.127ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2192024-11-25T19:31:16.133ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202024-11-25T19:31:16.133ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212024-11-25T19:31:16.134ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222024-11-25T19:31:16.137ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2232024-11-25T19:31:16.137ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242024-11-25T19:31:16.137ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252024-11-25T19:31:16.154ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262024-11-25T19:31:16.154ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272024-11-25T19:31:16.156ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282024-11-25T19:31:16.156ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2292024-11-25T19:31:16.157ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302024-11-25T19:31:16.157ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2312024-11-25T19:31:16.158ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322024-11-25T19:31:16.159ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332024-11-25T19:31:16.160ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342024-11-25T19:31:16.163ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2352024-11-25T19:31:16.163ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-11-25T19:31:16.163ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372024-11-25T19:31:16.195ZERROnexus (DataLoader): gave up trying to populate built-in PopulateBuiltinVpcs error_message = InternalError { internal_message: "Unknown diesel error creating VpcRouter called \\"system\\": Record not found" } file = nexus/src/populate.rs:126
2382024-11-25T19:31:16.195ZERROnexus: populate failed file = nexus/src/app/mod.rs:530
2392024-11-25T19:31:16.195ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:536
2402024-11-25T19:31:16.200ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
2412024-11-25T19:31:16.200ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
2422024-11-25T19:31:16.200ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2432024-11-25T19:31:16.200ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
2442024-11-25T19:31:16.200ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
2452024-11-25T19:31:16.200ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
2462024-11-25T19:31:16.200ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
2472024-11-25T19:31:16.200ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
2482024-11-25T19:31:16.200ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
2492024-11-25T19:31:16.200ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
2502024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
2512024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2522024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
2532024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
2542024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
2552024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
2562024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
2572024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
2582024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
2592024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
2602024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2612024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
2622024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
2632024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
2642024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2652024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2662024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2672024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
2682024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
2692024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
2702024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
2712024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
2722024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
2732024-11-25T19:31:16.201ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
2742024-11-25T19:31:16.201ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
2752024-11-25T19:31:16.201ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
2762024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2772024-11-25T19:31:16.201ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.564301ms iteration = 1 status = {"error":"no config nor servers"}
2782024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2792024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
2802024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
2812024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
2822024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2832024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
2842024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
2852024-11-25T19:31:16.202ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
2862024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2872024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
2882024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.809296ms iteration = 1 status = {"error":"no blueprint"}
2892024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2902024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
2912024-11-25T19:31:16.202ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
2922024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
2932024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
2942024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
2952024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
2962024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
2972024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
2982024-11-25T19:31:16.202ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
2992024-11-25T19:31:16.202ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
3002024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3012024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
3022024-11-25T19:31:16.202ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:21:16.200982554 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3032024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 2.06423ms iteration = 1 status = {"error":"no blueprint"}
3042024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3052024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
3062024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3072024-11-25T19:31:16.202ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3082024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
3092024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
3102024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3112024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
3122024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 2.313105ms iteration = 1 status = {"error":"no config nor servers"}
3132024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
3142024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
3152024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3162024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3172024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3182024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
3192024-11-25T19:31:16.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3202024-11-25T19:31:16.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3212024-11-25T19:31:16.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3222024-11-25T19:31:16.204ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1101, tv_nsec: 752653533 } })
3232024-11-25T19:31:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3242024-11-25T19:31:16.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3252024-11-25T19:31:16.204ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1101, tv_nsec: 752892718 } })
3262024-11-25T19:31:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3272024-11-25T19:31:16.204ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
3282024-11-25T19:31:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3292024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
3302024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3312024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
3322024-11-25T19:31:16.206ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
3332024-11-25T19:31:16.206ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
3342024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.849535ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
3352024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.884455ms iteration = 1 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
3362024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
3372024-11-25T19:31:16.206ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
3382024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
3392024-11-25T19:31:16.206ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
3402024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 3.77\u{b5}s iteration = 2 status = {"error":"no config"}
3412024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 6.32\u{b5}s iteration = 2 status = {"error":"no config"}
3422024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3432024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
3442024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3452024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3462024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
3472024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3482024-11-25T19:31:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
3492024-11-25T19:31:16.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3502024-11-25T19:31:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3512024-11-25T19:31:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3522024-11-25T19:31:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3532024-11-25T19:31:16.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
3542024-11-25T19:31:16.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3552024-11-25T19:31:16.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3562024-11-25T19:31:16.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3572024-11-25T19:31:16.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3582024-11-25T19:31:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
3592024-11-25T19:31:16.209ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3602024-11-25T19:31:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3612024-11-25T19:31:16.209ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3622024-11-25T19:31:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3632024-11-25T19:31:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3642024-11-25T19:31:16.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3652024-11-25T19:31:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3662024-11-25T19:31:16.211ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 10.970096ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
3672024-11-25T19:31:16.213ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:21:16.200982554 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
3682024-11-25T19:31:16.213ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.877883ms iteration = 1 status = {"expiration":"2024-11-25T19:21:16.200982554Z","pruned":[]}
3692024-11-25T19:31:16.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3702024-11-25T19:31:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3712024-11-25T19:31:16.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3722024-11-25T19:31:16.216ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.511065ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
3732024-11-25T19:31:16.217ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3742024-11-25T19:31:16.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3752024-11-25T19:31:16.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3762024-11-25T19:31:16.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3772024-11-25T19:31:16.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3782024-11-25T19:31:16.247ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1101, tv_nsec: 795591526 } })
3792024-11-25T19:31:16.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
3802024-11-25T19:31:16.248ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3812024-11-25T19:31:16.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3822024-11-25T19:31:16.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1101, tv_nsec: 797939172 } })
3832024-11-25T19:31:16.249ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
3842024-11-25T19:31:16.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3852024-11-25T19:31:16.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3862024-11-25T19:31:16.254ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3872024-11-25T19:31:16.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3882024-11-25T19:31:16.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3892024-11-25T19:31:16.256ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3902024-11-25T19:31:16.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3912024-11-25T19:31:16.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3922024-11-25T19:31:16.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3932024-11-25T19:31:16.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
3942024-11-25T19:31:16.259ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
3952024-11-25T19:31:16.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
3962024-11-25T19:31:16.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3972024-11-25T19:31:16.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3982024-11-25T19:31:16.262ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3992024-11-25T19:31:16.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4002024-11-25T19:31:16.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4012024-11-25T19:31:16.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4022024-11-25T19:31:16.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4032024-11-25T19:31:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
4042024-11-25T19:31:16.265ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4052024-11-25T19:31:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4062024-11-25T19:31:16.267ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4072024-11-25T19:31:16.267ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4082024-11-25T19:31:16.268ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
4092024-11-25T19:31:16.268ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 67.854961ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
4102024-11-25T19:31:16.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4112024-11-25T19:31:16.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4122024-11-25T19:31:16.270ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4132024-11-25T19:31:16.270ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
4142024-11-25T19:31:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4152024-11-25T19:31:16.270ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.580914ms iteration = 1 status = {"error":"inventory collection is None"}
4162024-11-25T19:31:16.270ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.639756ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
4172024-11-25T19:31:16.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
4182024-11-25T19:31:16.271ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4192024-11-25T19:31:16.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4202024-11-25T19:31:16.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4212024-11-25T19:31:16.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4222024-11-25T19:31:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4232024-11-25T19:31:16.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4242024-11-25T19:31:16.279ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4252024-11-25T19:31:16.279ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
4262024-11-25T19:31:16.279ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4272024-11-25T19:31:16.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4282024-11-25T19:31:16.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
4292024-11-25T19:31:16.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4302024-11-25T19:31:16.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4312024-11-25T19:31:16.282ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
4322024-11-25T19:31:16.282ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 81.956698ms iteration = 1 status = {"error":"rack not yet initialized: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c"}
4332024-11-25T19:31:16.282ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4342024-11-25T19:31:16.283ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 82.513109ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
4352024-11-25T19:31:16.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4362024-11-25T19:31:16.288ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 87.528048ms iteration = 1 status = {}
4372024-11-25T19:31:16.288ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
4382024-11-25T19:31:16.288ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.098179ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
4392024-11-25T19:31:16.293ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4402024-11-25T19:31:16.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4412024-11-25T19:31:16.294ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
4422024-11-25T19:31:16.294ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
4432024-11-25T19:31:16.294ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 93.77245ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
4442024-11-25T19:31:16.294ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4452024-11-25T19:31:16.297ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4462024-11-25T19:31:16.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4472024-11-25T19:31:16.297ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
4482024-11-25T19:31:16.297ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4492024-11-25T19:31:16.298ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de5554b4-b156-4822-ba13-421485e5fa6a", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
4502024-11-25T19:31:16.298ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4512024-11-25T19:31:16.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
4522024-11-25T19:31:16.298ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4532024-11-25T19:31:16.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4542024-11-25T19:31:16.299ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4552024-11-25T19:31:16.302ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
4562024-11-25T19:31:16.302ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4572024-11-25T19:31:16.303ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c50fcddd-aa36-40cf-899d-8498cf17bfbf", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
4582024-11-25T19:31:16.303ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4592024-11-25T19:31:16.304ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4602024-11-25T19:31:16.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4612024-11-25T19:31:16.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4622024-11-25T19:31:16.315ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
4632024-11-25T19:31:16.316ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1101, tv_nsec: 864493777 } })
4642024-11-25T19:31:16.325ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
4652024-11-25T19:31:16.325ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
4662024-11-25T19:31:16.325ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 125.095055ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
4672024-11-25T19:31:16.329ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4682024-11-25T19:31:16.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4692024-11-25T19:31:16.330ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4702024-11-25T19:31:16.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4712024-11-25T19:31:16.334ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4722024-11-25T19:31:16.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4732024-11-25T19:31:16.337ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
4742024-11-25T19:31:16.337ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 137.259402ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
4752024-11-25T19:31:16.339ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 138.777133ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
4762024-11-25T19:31:16.349ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
4772024-11-25T19:31:16.349ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 149.199287ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
4782024-11-25T19:31:16.358ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
4792024-11-25T19:31:16.358ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 158.343057ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
4802024-11-25T19:31:16.359ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4812024-11-25T19:31:16.359ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
4822024-11-25T19:31:16.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4832024-11-25T19:31:16.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4842024-11-25T19:31:16.367ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 166.688401ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4852024-11-25T19:31:16.368ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 168.546307ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
4862024-11-25T19:31:16.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 174.783949ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
4872024-11-25T19:31:16.375ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 175.001233ms iteration = 1 status = {}
4882024-11-25T19:31:16.375ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4892024-11-25T19:31:16.375ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
4902024-11-25T19:31:16.375ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
4912024-11-25T19:31:16.375ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
4922024-11-25T19:31:16.377ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "c09d6eca-fdc6-4370-9123-69848a3439e9", "content-length": "476", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
4932024-11-25T19:31:16.377ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6bf5ced-9d61-4bf4-913d-2f64098fabce", "content-length": "1", "date": "Mon, 25 Nov 2024 19:31:15 GMT"} })
4942024-11-25T19:31:16.377ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 177.423711ms iteration = 1 status = {}
4952024-11-25T19:31:16.378ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
4962024-11-25T19:31:16.378ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4972024-11-25T19:31:16.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4982024-11-25T19:31:16.379ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec43a649-530a-4a48-a987-2633a3e1f5c4", "content-length": "734", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
4992024-11-25T19:31:16.379ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
5002024-11-25T19:31:16.379ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e01ccca-4efc-49d0-ad01-1db029f50b19", "content-length": "111", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5012024-11-25T19:31:16.380ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
5022024-11-25T19:31:16.381ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "53e9e0c8-6916-405b-b2cd-e3603279e061", "content-length": "111", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5032024-11-25T19:31:16.381ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
5042024-11-25T19:31:16.381ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8de0d177-c3e8-430b-af4b-fb6f4290cc4e", "content-length": "167", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5052024-11-25T19:31:16.381ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
5062024-11-25T19:31:16.382ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f4e57a7-0086-4a55-a9a3-920f4d4d238d", "content-length": "167", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5072024-11-25T19:31:16.382ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
5082024-11-25T19:31:16.382ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "addc2499-6e76-42c2-97c5-d49c6be72958", "content-length": "175", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5092024-11-25T19:31:16.382ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
5102024-11-25T19:31:16.382ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "10c5575f-7af6-49ca-98e9-39de45500771", "content-length": "175", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5112024-11-25T19:31:16.382ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
5122024-11-25T19:31:16.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5132024-11-25T19:31:16.386ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "36e870b6-b54d-49cd-870c-322eb676a9ee", "content-length": "702", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5142024-11-25T19:31:16.387ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
5152024-11-25T19:31:16.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5162024-11-25T19:31:16.389ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5172024-11-25T19:31:16.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5182024-11-25T19:31:16.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5192024-11-25T19:31:16.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5202024-11-25T19:31:16.392ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 192.241092ms iteration = 1 status = null
5212024-11-25T19:31:16.393ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca367075-13e5-4d77-a174-9ad4dcc259ef", "content-length": "727", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5222024-11-25T19:31:16.393ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
5232024-11-25T19:31:16.393ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d6235cb-68ca-4a97-840d-311a3913a654", "content-length": "729", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5242024-11-25T19:31:16.393ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
5252024-11-25T19:31:16.394ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4539df6-a21e-4eca-a5a7-5833dc643779", "content-length": "728", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5262024-11-25T19:31:16.394ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
5272024-11-25T19:31:16.394ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5282024-11-25T19:31:16.394ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca6aee5e-5288-4363-9ad7-36c4c8d2e767", "content-length": "722", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5292024-11-25T19:31:16.394ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
5302024-11-25T19:31:16.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5312024-11-25T19:31:16.394ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fece4b82-a723-4847-bf77-27e5f44037d6", "content-length": "109", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5322024-11-25T19:31:16.394ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
5332024-11-25T19:31:16.395ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "635edd58-8eac-41ac-a054-fb7db3925304", "content-length": "109", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5342024-11-25T19:31:16.395ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
5352024-11-25T19:31:16.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5362024-11-25T19:31:16.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5372024-11-25T19:31:16.395ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "26081f5a-688e-4bc8-b7f7-02ebf860e6c8", "content-length": "169", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5382024-11-25T19:31:16.395ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
5392024-11-25T19:31:16.395ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "03fba10d-c45b-4e20-a0c0-437de3d2d941", "content-length": "169", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5402024-11-25T19:31:16.395ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
5412024-11-25T19:31:16.396ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5422024-11-25T19:31:16.396ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdd28fee-9144-441d-befd-9757a92a25a5", "content-length": "178", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5432024-11-25T19:31:16.396ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
5442024-11-25T19:31:16.396ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7491599b-7ce3-4e11-9294-7085b8bf8770", "content-length": "178", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5452024-11-25T19:31:16.396ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
5462024-11-25T19:31:16.396ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ffba6c9-212d-46ae-a09b-30b074cfbfb5", "content-length": "702", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5472024-11-25T19:31:16.396ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
5482024-11-25T19:31:16.396ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8e6c844-a369-4573-be84-1f764a0e57f1", "content-length": "727", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5492024-11-25T19:31:16.396ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
5502024-11-25T19:31:16.396ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "504b37da-1459-4d69-a135-7d5ff5a158a9", "content-length": "729", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5512024-11-25T19:31:16.396ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
5522024-11-25T19:31:16.397ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3decdb0f-8ff9-484b-8abd-1fa95ab19407", "content-length": "728", "date": "Mon, 25 Nov 2024 19:31:16 GMT"} })
5532024-11-25T19:31:16.397ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5542024-11-25T19:31:16.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5552024-11-25T19:31:16.398ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5562024-11-25T19:31:16.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5572024-11-25T19:31:16.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5582024-11-25T19:31:16.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5592024-11-25T19:31:16.400ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5602024-11-25T19:31:16.400ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 200.001375ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5612024-11-25T19:31:16.400ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5622024-11-25T19:31:16.400ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
5632024-11-25T19:31:16.400ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5642024-11-25T19:31:16.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5652024-11-25T19:31:16.401ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
5662024-11-25T19:31:16.401ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 200.804489ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
5672024-11-25T19:31:16.402ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5682024-11-25T19:31:16.403ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
5692024-11-25T19:31:16.403ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5702024-11-25T19:31:16.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5712024-11-25T19:31:16.410ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
5722024-11-25T19:31:16.410ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 209.908288ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
5732024-11-25T19:31:16.420ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5742024-11-25T19:31:16.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5752024-11-25T19:31:16.432ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5762024-11-25T19:31:16.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5772024-11-25T19:31:16.434ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5782024-11-25T19:31:16.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5792024-11-25T19:31:16.436ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5802024-11-25T19:31:16.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5812024-11-25T19:31:16.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5822024-11-25T19:31:16.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5832024-11-25T19:31:16.439ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5842024-11-25T19:31:16.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5852024-11-25T19:31:16.440ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862024-11-25T19:31:16.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5872024-11-25T19:31:16.445ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
5882024-11-25T19:31:16.445ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5892024-11-25T19:31:16.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5902024-11-25T19:31:16.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5912024-11-25T19:31:16.448ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
5922024-11-25T19:31:16.448ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5932024-11-25T19:31:16.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5942024-11-25T19:31:16.457ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
5952024-11-25T19:31:16.457ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
5962024-11-25T19:31:16.457ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
5972024-11-25T19:31:16.460ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
5982024-11-25T19:31:16.460ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
5992024-11-25T19:31:16.460ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
6002024-11-25T19:31:16.461ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6012024-11-25T19:31:16.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6022024-11-25T19:31:16.462ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6032024-11-25T19:31:16.464ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
6042024-11-25T19:31:16.464ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6052024-11-25T19:31:16.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6062024-11-25T19:31:16.552ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
6072024-11-25T19:31:16.552ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
6082024-11-25T19:31:16.552ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
6092024-11-25T19:31:16.553ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 350.065838ms
6102024-11-25T19:31:16.553ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 351.934825ms iteration = 1 status = {}
6112024-11-25T19:31:16.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6122024-11-25T19:31:16.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6132024-11-25T19:31:16.568ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6142024-11-25T19:31:16.570ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6152024-11-25T19:31:16.570ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6162024-11-25T19:31:16.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6172024-11-25T19:31:16.572ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6182024-11-25T19:31:16.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6192024-11-25T19:31:16.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6202024-11-25T19:31:16.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6212024-11-25T19:31:16.575ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 375.300903ms iteration = 1 status = {}
6222024-11-25T19:31:16.589ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 4cc640c1-8be3-451a-af98-2c0913656c3d file = nexus/db-queries/src/db/datastore/inventory.rs:1000
6232024-11-25T19:31:16.589ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 4cc640c1-8be3-451a-af98-2c0913656c3d time_started = 2024-11-25 19:31:16.375216 UTC
6242024-11-25T19:31:16.589ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 389.097964ms iteration = 1 status = {"collection_id":"4cc640c1-8be3-451a-af98-2c0913656c3d","time_done":"2024-11-25 19:31:16.460398 UTC","time_started":"2024-11-25 19:31:16.375216 UTC"}
6252024-11-25T19:31:16.589ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
6262024-11-25T19:31:16.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6272024-11-25T19:31:16.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6282024-11-25T19:31:16.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6292024-11-25T19:31:16.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6302024-11-25T19:31:16.593ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6312024-11-25T19:31:16.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6322024-11-25T19:31:16.594ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
6332024-11-25T19:31:16.594ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 4.859355ms iteration = 2 status = {"error":"rack not yet initialized: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c"}
6342024-11-25T19:31:16.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ac9c8ba7-7b2e-4692-9a04-5cfa36b6d0a6 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6352024-11-25T19:31:16.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ac9c8ba7-7b2e-4692-9a04-5cfa36b6d0a6 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6362024-11-25T19:31:16.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ac9c8ba7-7b2e-4692-9a04-5cfa36b6d0a6 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6372024-11-25T19:31:16.685ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ac9c8ba7-7b2e-4692-9a04-5cfa36b6d0a6 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6382024-11-25T19:31:16.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ac9c8ba7-7b2e-4692-9a04-5cfa36b6d0a6 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6392024-11-25T19:31:16.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ac9c8ba7-7b2e-4692-9a04-5cfa36b6d0a6 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6402024-11-25T19:31:16.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ac9c8ba7-7b2e-4692-9a04-5cfa36b6d0a6 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6412024-11-25T19:31:16.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ac9c8ba7-7b2e-4692-9a04-5cfa36b6d0a6 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6422024-11-25T19:31:16.703ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c" error_message_internal = not found: rack with id "bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 21645 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ac9c8ba7-7b2e-4692-9a04-5cfa36b6d0a6 response_code = 404 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6432024-11-25T19:31:16.721ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6442024-11-25T19:31:16.721ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6452024-11-25T19:31:16.722ZWARNnexus: Cannot look up rack: Object (of type ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c)) not found: rack file = nexus/src/app/rack.rs:774
6462024-11-25T19:31:18.397ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:47361
6472024-11-25T19:31:18.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47361 req_id = 6a2473b5-2599-44b7-8ad0-f2dfdc7f14dc roles = RoleSet { roles: {} } uri = /metrics/producers
6482024-11-25T19:31:18.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47361 req_id = 6a2473b5-2599-44b7-8ad0-f2dfdc7f14dc resource = Database result = Ok(()) uri = /metrics/producers
6492024-11-25T19:31:18.433ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no Oximeter instances available for assignment file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 35764 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47361 req_id = 6a2473b5-2599-44b7-8ad0-f2dfdc7f14dc response_code = 503 uri = /metrics/producers
6502024-11-25T19:31:18.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6512024-11-25T19:31:18.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6522024-11-25T19:31:18.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6532024-11-25T19:31:18.571ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6542024-11-25T19:31:18.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6552024-11-25T19:31:18.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6562024-11-25T19:31:18.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6572024-11-25T19:31:18.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6582024-11-25T19:31:18.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6592024-11-25T19:31:18.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6602024-11-25T19:31:18.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6612024-11-25T19:31:18.581ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6622024-11-25T19:31:18.581ZDEBGnexus (dropshot_internal): updating rack subnet for rack bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6632024-11-25T19:31:18.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6642024-11-25T19:31:18.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6652024-11-25T19:31:18.585ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6662024-11-25T19:31:18.615ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6672024-11-25T19:31:18.617ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "87afc092-9b5c-4c4a-9765-37526de9df83", "content-length": "24", "date": "Mon, 25 Nov 2024 19:31:17 GMT"} }) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6682024-11-25T19:31:18.619ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6692024-11-25T19:31:18.619ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6702024-11-25T19:31:18.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6712024-11-25T19:31:18.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6722024-11-25T19:31:18.640ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6732024-11-25T19:31:18.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6742024-11-25T19:31:18.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6752024-11-25T19:31:18.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6762024-11-25T19:31:18.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6772024-11-25T19:31:18.723ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6782024-11-25T19:31:18.723ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6792024-11-25T19:31:18.724ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
6802024-11-25T19:31:18.724ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
6812024-11-25T19:31:18.726ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6822024-11-25T19:31:18.728ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
6832024-11-25T19:31:18.728ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
6842024-11-25T19:31:18.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6852024-11-25T19:31:18.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6862024-11-25T19:31:18.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6872024-11-25T19:31:18.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6882024-11-25T19:31:18.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6892024-11-25T19:31:18.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6902024-11-25T19:31:18.794ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6912024-11-25T19:31:18.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6922024-11-25T19:31:18.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6932024-11-25T19:31:18.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6942024-11-25T19:31:18.803ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6952024-11-25T19:31:18.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6962024-11-25T19:31:18.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6972024-11-25T19:31:18.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6982024-11-25T19:31:18.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
6992024-11-25T19:31:18.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7002024-11-25T19:31:18.809ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = IpPool { parent: Fleet, key: d3ec4b13-a602-4bf3-88ba-c1399c028072, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7012024-11-25T19:31:18.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7022024-11-25T19:31:18.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7032024-11-25T19:31:18.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7042024-11-25T19:31:18.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7052024-11-25T19:31:18.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7062024-11-25T19:31:18.814ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = IpPool { parent: Fleet, key: d3ec4b13-a602-4bf3-88ba-c1399c028072, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7072024-11-25T19:31:18.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7082024-11-25T19:31:18.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7092024-11-25T19:31:18.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7102024-11-25T19:31:18.845ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = BlueprintConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7112024-11-25T19:31:18.987ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = c0042f8f-3059-4f90-9d41-8b34f2747978 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7122024-11-25T19:31:18.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7132024-11-25T19:31:18.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7142024-11-25T19:31:18.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7152024-11-25T19:31:18.991ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = BlueprintConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7162024-11-25T19:31:19.002ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7172024-11-25T19:31:19.002ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7182024-11-25T19:31:19.002ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7192024-11-25T19:31:19.002ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7202024-11-25T19:31:19.002ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7212024-11-25T19:31:19.002ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7222024-11-25T19:31:19.002ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7232024-11-25T19:31:19.002ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7242024-11-25T19:31:19.096ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7252024-11-25T19:31:19.122ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7262024-11-25T19:31:19.144ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7272024-11-25T19:31:19.171ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7282024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7292024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7302024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7312024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7322024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7332024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7342024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7352024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7362024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7372024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7382024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7392024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7402024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7412024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7422024-11-25T19:31:19.193ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7432024-11-25T19:31:19.216ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7442024-11-25T19:31:19.216ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7452024-11-25T19:31:19.216ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b048b34a-75aa-4bad-b776-d3f8f218c18c, time_created: 2024-11-25T19:31:18.571781939Z, time_modified: 2024-11-25T19:31:18.571781939Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7462024-11-25T19:31:19.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7472024-11-25T19:31:19.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7482024-11-25T19:31:19.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7492024-11-25T19:31:19.220ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7502024-11-25T19:31:19.240ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(38711855-ef69-4d79-bb75-aebd85b1280b)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7512024-11-25T19:31:19.245ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "38711855-ef69-4d79-bb75-aebd85b1280b" error_message_internal = not found: sled with id "38711855-ef69-4d79-bb75-aebd85b1280b" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 677789 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = ccf9a2fc-d510-4af7-841e-c1212a491b5a response_code = 404 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7522024-11-25T19:31:20.729ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7532024-11-25T19:31:20.729ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7542024-11-25T19:31:20.730ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7552024-11-25T19:31:20.730ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7562024-11-25T19:31:20.732ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7572024-11-25T19:31:20.734ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
7582024-11-25T19:31:20.735ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
7592024-11-25T19:31:21.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7602024-11-25T19:31:21.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7612024-11-25T19:31:21.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7622024-11-25T19:31:21.183ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7632024-11-25T19:31:21.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7642024-11-25T19:31:21.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7652024-11-25T19:31:21.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7662024-11-25T19:31:21.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7672024-11-25T19:31:21.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7682024-11-25T19:31:21.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7692024-11-25T19:31:21.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7702024-11-25T19:31:21.220ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7712024-11-25T19:31:21.220ZDEBGnexus (dropshot_internal): updating rack subnet for rack bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7722024-11-25T19:31:21.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7732024-11-25T19:31:21.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7742024-11-25T19:31:21.226ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7752024-11-25T19:31:21.258ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7762024-11-25T19:31:21.258ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd1cc3f3-1470-4ce6-9a2d-622e4b7f49b6", "content-length": "24", "date": "Mon, 25 Nov 2024 19:31:20 GMT"} }) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7772024-11-25T19:31:21.258ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7782024-11-25T19:31:21.258ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7792024-11-25T19:31:21.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7802024-11-25T19:31:21.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7812024-11-25T19:31:21.286ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7822024-11-25T19:31:21.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7832024-11-25T19:31:21.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7842024-11-25T19:31:21.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7852024-11-25T19:31:21.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7862024-11-25T19:31:21.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7872024-11-25T19:31:21.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7882024-11-25T19:31:21.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7892024-11-25T19:31:21.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7902024-11-25T19:31:21.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7912024-11-25T19:31:21.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7922024-11-25T19:31:21.334ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7932024-11-25T19:31:21.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7942024-11-25T19:31:21.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7952024-11-25T19:31:21.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7962024-11-25T19:31:21.339ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7972024-11-25T19:31:21.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7982024-11-25T19:31:21.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
7992024-11-25T19:31:21.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8002024-11-25T19:31:21.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8012024-11-25T19:31:21.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8022024-11-25T19:31:21.350ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = IpPool { parent: Fleet, key: d3ec4b13-a602-4bf3-88ba-c1399c028072, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8032024-11-25T19:31:21.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8042024-11-25T19:31:21.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8052024-11-25T19:31:21.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8062024-11-25T19:31:21.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8072024-11-25T19:31:21.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8082024-11-25T19:31:21.355ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = IpPool { parent: Fleet, key: d3ec4b13-a602-4bf3-88ba-c1399c028072, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8092024-11-25T19:31:21.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8102024-11-25T19:31:21.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8112024-11-25T19:31:21.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8122024-11-25T19:31:21.365ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = BlueprintConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8132024-11-25T19:31:21.440ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = c0042f8f-3059-4f90-9d41-8b34f2747978 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8142024-11-25T19:31:21.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8152024-11-25T19:31:21.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8162024-11-25T19:31:21.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8172024-11-25T19:31:21.444ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = BlueprintConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8182024-11-25T19:31:21.456ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8192024-11-25T19:31:21.456ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8202024-11-25T19:31:21.456ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8212024-11-25T19:31:21.456ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8222024-11-25T19:31:21.456ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8232024-11-25T19:31:21.456ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8242024-11-25T19:31:21.456ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8252024-11-25T19:31:21.456ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8262024-11-25T19:31:21.536ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8272024-11-25T19:31:21.557ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8282024-11-25T19:31:21.583ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8292024-11-25T19:31:21.603ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8302024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8312024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8322024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8332024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8342024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8352024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8362024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8372024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8382024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8392024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8402024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8412024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8422024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8432024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8442024-11-25T19:31:21.623ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8452024-11-25T19:31:21.644ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8462024-11-25T19:31:21.644ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8472024-11-25T19:31:21.644ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b048b34a-75aa-4bad-b776-d3f8f218c18c, time_created: 2024-11-25T19:31:21.183519811Z, time_modified: 2024-11-25T19:31:21.183519811Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8482024-11-25T19:31:21.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8492024-11-25T19:31:21.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8502024-11-25T19:31:21.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8512024-11-25T19:31:21.647ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8522024-11-25T19:31:21.664ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(38711855-ef69-4d79-bb75-aebd85b1280b)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8532024-11-25T19:31:21.670ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "38711855-ef69-4d79-bb75-aebd85b1280b" error_message_internal = not found: sled with id "38711855-ef69-4d79-bb75-aebd85b1280b" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 491232 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 35cea67c-2c12-4b64-adee-ad9d9417d63d response_code = 404 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8542024-11-25T19:31:22.261ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:37852
8552024-11-25T19:31:22.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:37852 req_id = 27fe52de-99cd-47a5-8fb4-72c0125ec84c roles = RoleSet { roles: {} } uri = /metrics/collectors
8562024-11-25T19:31:22.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:37852 req_id = 27fe52de-99cd-47a5-8fb4-72c0125ec84c resource = Database result = Ok(()) uri = /metrics/collectors
8572024-11-25T19:31:22.272ZINFOnexus: registered new oximeter metric collection server address = [fd00:1122:3344:101::d]:12223 collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:41
8582024-11-25T19:31:22.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9218 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:37852 req_id = 27fe52de-99cd-47a5-8fb4-72c0125ec84c response_code = 204 uri = /metrics/collectors
8592024-11-25T19:31:22.735ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8602024-11-25T19:31:22.736ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8612024-11-25T19:31:22.737ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8622024-11-25T19:31:22.737ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8632024-11-25T19:31:22.739ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8642024-11-25T19:31:22.742ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
8652024-11-25T19:31:22.742ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8662024-11-25T19:31:24.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8672024-11-25T19:31:24.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8682024-11-25T19:31:24.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8692024-11-25T19:31:24.092ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8702024-11-25T19:31:24.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8712024-11-25T19:31:24.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8722024-11-25T19:31:24.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8732024-11-25T19:31:24.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8742024-11-25T19:31:24.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8752024-11-25T19:31:24.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8762024-11-25T19:31:24.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8772024-11-25T19:31:24.102ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8782024-11-25T19:31:24.102ZDEBGnexus (dropshot_internal): updating rack subnet for rack bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8792024-11-25T19:31:24.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8802024-11-25T19:31:24.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8812024-11-25T19:31:24.107ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8822024-11-25T19:31:24.139ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8832024-11-25T19:31:24.139ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "046274db-52fa-4d29-a04a-2a0918bdfdea", "content-length": "24", "date": "Mon, 25 Nov 2024 19:31:23 GMT"} }) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8842024-11-25T19:31:24.139ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8852024-11-25T19:31:24.139ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8862024-11-25T19:31:24.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8872024-11-25T19:31:24.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8882024-11-25T19:31:24.153ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8892024-11-25T19:31:24.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8902024-11-25T19:31:24.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8912024-11-25T19:31:24.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8922024-11-25T19:31:24.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8932024-11-25T19:31:24.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8942024-11-25T19:31:24.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8952024-11-25T19:31:24.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8962024-11-25T19:31:24.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8972024-11-25T19:31:24.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8982024-11-25T19:31:24.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
8992024-11-25T19:31:24.185ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9002024-11-25T19:31:24.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9012024-11-25T19:31:24.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9022024-11-25T19:31:24.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9032024-11-25T19:31:24.189ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9042024-11-25T19:31:24.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9052024-11-25T19:31:24.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9062024-11-25T19:31:24.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9072024-11-25T19:31:24.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9082024-11-25T19:31:24.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9092024-11-25T19:31:24.196ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = IpPool { parent: Fleet, key: d3ec4b13-a602-4bf3-88ba-c1399c028072, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9102024-11-25T19:31:24.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9112024-11-25T19:31:24.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9122024-11-25T19:31:24.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9132024-11-25T19:31:24.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9142024-11-25T19:31:24.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9152024-11-25T19:31:24.200ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = IpPool { parent: Fleet, key: d3ec4b13-a602-4bf3-88ba-c1399c028072, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9162024-11-25T19:31:24.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9172024-11-25T19:31:24.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9182024-11-25T19:31:24.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9192024-11-25T19:31:24.210ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = BlueprintConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9202024-11-25T19:31:24.285ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = c0042f8f-3059-4f90-9d41-8b34f2747978 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9212024-11-25T19:31:24.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9222024-11-25T19:31:24.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9232024-11-25T19:31:24.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9242024-11-25T19:31:24.288ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = BlueprintConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9252024-11-25T19:31:24.291ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9262024-11-25T19:31:24.291ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9272024-11-25T19:31:24.291ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9282024-11-25T19:31:24.291ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9292024-11-25T19:31:24.291ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9302024-11-25T19:31:24.291ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9312024-11-25T19:31:24.291ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9322024-11-25T19:31:24.291ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9332024-11-25T19:31:24.351ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9342024-11-25T19:31:24.374ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9352024-11-25T19:31:24.389ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9362024-11-25T19:31:24.404ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9372024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9382024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9392024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9402024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9412024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9422024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9432024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9442024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9452024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9462024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9472024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9482024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9492024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9502024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9512024-11-25T19:31:24.429ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9522024-11-25T19:31:24.445ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9532024-11-25T19:31:24.445ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9542024-11-25T19:31:24.445ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b048b34a-75aa-4bad-b776-d3f8f218c18c, time_created: 2024-11-25T19:31:24.092359952Z, time_modified: 2024-11-25T19:31:24.092359952Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9552024-11-25T19:31:24.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9562024-11-25T19:31:24.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9572024-11-25T19:31:24.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9582024-11-25T19:31:24.449ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9592024-11-25T19:31:24.468ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(38711855-ef69-4d79-bb75-aebd85b1280b)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9602024-11-25T19:31:24.472ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "38711855-ef69-4d79-bb75-aebd85b1280b" error_message_internal = not found: sled with id "38711855-ef69-4d79-bb75-aebd85b1280b" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 384604 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 93ed4652-1815-4a8c-a692-6a207c9bc365 response_code = 404 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9612024-11-25T19:31:24.743ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9622024-11-25T19:31:24.743ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9632024-11-25T19:31:24.744ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9642024-11-25T19:31:24.744ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9652024-11-25T19:31:24.746ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9662024-11-25T19:31:24.748ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
9672024-11-25T19:31:24.748ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9682024-11-25T19:31:26.200ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
9692024-11-25T19:31:26.200ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9702024-11-25T19:31:26.200ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
9712024-11-25T19:31:26.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9722024-11-25T19:31:26.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9732024-11-25T19:31:26.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9742024-11-25T19:31:26.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9752024-11-25T19:31:26.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9762024-11-25T19:31:26.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9772024-11-25T19:31:26.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9782024-11-25T19:31:26.207ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
9792024-11-25T19:31:26.207ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.720862ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
9802024-11-25T19:31:26.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9812024-11-25T19:31:26.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9822024-11-25T19:31:26.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.659719ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9832024-11-25T19:31:26.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9842024-11-25T19:31:26.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9852024-11-25T19:31:26.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9862024-11-25T19:31:26.358ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9872024-11-25T19:31:26.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9882024-11-25T19:31:26.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9892024-11-25T19:31:26.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9902024-11-25T19:31:26.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9912024-11-25T19:31:26.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9922024-11-25T19:31:26.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9932024-11-25T19:31:26.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9942024-11-25T19:31:26.366ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9952024-11-25T19:31:26.366ZDEBGnexus (dropshot_internal): updating rack subnet for rack bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9962024-11-25T19:31:26.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9972024-11-25T19:31:26.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9982024-11-25T19:31:26.373ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
9992024-11-25T19:31:26.403ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10002024-11-25T19:31:26.403ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "657080d4-08b5-455c-a59c-8ae4c099bc25", "content-length": "24", "date": "Mon, 25 Nov 2024 19:31:25 GMT"} }) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10012024-11-25T19:31:26.403ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10022024-11-25T19:31:26.403ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10032024-11-25T19:31:26.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10042024-11-25T19:31:26.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10052024-11-25T19:31:26.416ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10062024-11-25T19:31:26.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10072024-11-25T19:31:26.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10082024-11-25T19:31:26.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10092024-11-25T19:31:26.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10102024-11-25T19:31:26.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10112024-11-25T19:31:26.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10122024-11-25T19:31:26.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10132024-11-25T19:31:26.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10142024-11-25T19:31:26.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10152024-11-25T19:31:26.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10162024-11-25T19:31:26.428ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10172024-11-25T19:31:26.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10182024-11-25T19:31:26.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10192024-11-25T19:31:26.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10202024-11-25T19:31:26.431ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10212024-11-25T19:31:26.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10222024-11-25T19:31:26.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10232024-11-25T19:31:26.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10242024-11-25T19:31:26.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10252024-11-25T19:31:26.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10262024-11-25T19:31:26.437ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = IpPool { parent: Fleet, key: d3ec4b13-a602-4bf3-88ba-c1399c028072, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10272024-11-25T19:31:26.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10282024-11-25T19:31:26.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10292024-11-25T19:31:26.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10302024-11-25T19:31:26.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10312024-11-25T19:31:26.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10322024-11-25T19:31:26.441ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = IpPool { parent: Fleet, key: d3ec4b13-a602-4bf3-88ba-c1399c028072, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10332024-11-25T19:31:26.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10342024-11-25T19:31:26.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10352024-11-25T19:31:26.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10362024-11-25T19:31:26.447ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = BlueprintConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10372024-11-25T19:31:26.457ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = c0042f8f-3059-4f90-9d41-8b34f2747978 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10382024-11-25T19:31:26.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10392024-11-25T19:31:26.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10402024-11-25T19:31:26.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10412024-11-25T19:31:26.460ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = BlueprintConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10422024-11-25T19:31:26.462ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10432024-11-25T19:31:26.463ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10442024-11-25T19:31:26.463ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10452024-11-25T19:31:26.463ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10462024-11-25T19:31:26.463ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10472024-11-25T19:31:26.463ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10482024-11-25T19:31:26.463ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10492024-11-25T19:31:26.463ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10502024-11-25T19:31:26.477ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10512024-11-25T19:31:26.492ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10522024-11-25T19:31:26.511ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10532024-11-25T19:31:26.526ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10542024-11-25T19:31:26.541ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10552024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10562024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10572024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10582024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10592024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10602024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10612024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10622024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10632024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10642024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10652024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10662024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10672024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10682024-11-25T19:31:26.542ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10692024-11-25T19:31:26.557ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10702024-11-25T19:31:26.557ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10712024-11-25T19:31:26.557ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b048b34a-75aa-4bad-b776-d3f8f218c18c, time_created: 2024-11-25T19:31:26.358793899Z, time_modified: 2024-11-25T19:31:26.358793899Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10722024-11-25T19:31:26.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10732024-11-25T19:31:26.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10742024-11-25T19:31:26.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10752024-11-25T19:31:26.561ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10762024-11-25T19:31:26.563ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(38711855-ef69-4d79-bb75-aebd85b1280b)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10772024-11-25T19:31:26.567ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "38711855-ef69-4d79-bb75-aebd85b1280b" error_message_internal = not found: sled with id "38711855-ef69-4d79-bb75-aebd85b1280b" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 212740 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 8cc7d22e-8220-4952-9668-db22842da52e response_code = 404 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10782024-11-25T19:31:26.749ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10792024-11-25T19:31:26.749ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10802024-11-25T19:31:26.750ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10812024-11-25T19:31:26.751ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10822024-11-25T19:31:26.752ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10832024-11-25T19:31:26.755ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
10842024-11-25T19:31:26.755ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
10852024-11-25T19:31:28.453ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:56611
10862024-11-25T19:31:28.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56611 req_id = ce2beab5-3ff4-4327-a60b-8007b580ef8a roles = RoleSet { roles: {} } uri = /metrics/producers
10872024-11-25T19:31:28.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56611 req_id = ce2beab5-3ff4-4327-a60b-8007b580ef8a resource = Database result = Ok(()) uri = /metrics/producers
10882024-11-25T19:31:28.502ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 38711855-ef69-4d79-bb75-aebd85b1280b
10892024-11-25T19:31:28.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49080 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56611 req_id = ce2beab5-3ff4-4327-a60b-8007b580ef8a response_code = 201 uri = /metrics/producers
10902024-11-25T19:31:28.756ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10912024-11-25T19:31:28.757ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10922024-11-25T19:31:28.758ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10932024-11-25T19:31:28.759ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10942024-11-25T19:31:28.760ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10952024-11-25T19:31:28.763ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
10962024-11-25T19:31:28.763ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
10972024-11-25T19:31:29.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10982024-11-25T19:31:29.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
10992024-11-25T19:31:29.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11002024-11-25T19:31:29.892ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11012024-11-25T19:31:29.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11022024-11-25T19:31:29.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11032024-11-25T19:31:29.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11042024-11-25T19:31:29.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11052024-11-25T19:31:29.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11062024-11-25T19:31:29.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11072024-11-25T19:31:29.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11082024-11-25T19:31:29.919ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11092024-11-25T19:31:29.919ZDEBGnexus (dropshot_internal): updating rack subnet for rack bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11102024-11-25T19:31:29.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11112024-11-25T19:31:29.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11122024-11-25T19:31:29.924ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11132024-11-25T19:31:29.956ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11142024-11-25T19:31:29.957ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e020ff2-f5ff-494d-97eb-6fe8be2f7246", "content-length": "24", "date": "Mon, 25 Nov 2024 19:31:29 GMT"} }) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11152024-11-25T19:31:29.957ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11162024-11-25T19:31:29.957ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11172024-11-25T19:31:29.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11182024-11-25T19:31:29.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11192024-11-25T19:31:29.971ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11202024-11-25T19:31:29.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11212024-11-25T19:31:29.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11222024-11-25T19:31:29.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11232024-11-25T19:31:29.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11242024-11-25T19:31:29.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11252024-11-25T19:31:29.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11262024-11-25T19:31:29.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11272024-11-25T19:31:29.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11282024-11-25T19:31:29.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11292024-11-25T19:31:29.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11302024-11-25T19:31:30.003ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11312024-11-25T19:31:30.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11322024-11-25T19:31:30.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11332024-11-25T19:31:30.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11342024-11-25T19:31:30.007ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11352024-11-25T19:31:30.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11362024-11-25T19:31:30.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11372024-11-25T19:31:30.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11382024-11-25T19:31:30.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11392024-11-25T19:31:30.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11402024-11-25T19:31:30.013ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = IpPool { parent: Fleet, key: d3ec4b13-a602-4bf3-88ba-c1399c028072, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11412024-11-25T19:31:30.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11422024-11-25T19:31:30.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11432024-11-25T19:31:30.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11442024-11-25T19:31:30.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11452024-11-25T19:31:30.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11462024-11-25T19:31:30.018ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = IpPool { parent: Fleet, key: d3ec4b13-a602-4bf3-88ba-c1399c028072, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11472024-11-25T19:31:30.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11482024-11-25T19:31:30.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11492024-11-25T19:31:30.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11502024-11-25T19:31:30.059ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = BlueprintConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11512024-11-25T19:31:30.206ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = c0042f8f-3059-4f90-9d41-8b34f2747978 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11522024-11-25T19:31:30.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11532024-11-25T19:31:30.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11542024-11-25T19:31:30.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11552024-11-25T19:31:30.210ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = BlueprintConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11562024-11-25T19:31:30.221ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11572024-11-25T19:31:30.221ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11582024-11-25T19:31:30.221ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11592024-11-25T19:31:30.221ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11602024-11-25T19:31:30.222ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11612024-11-25T19:31:30.222ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11622024-11-25T19:31:30.222ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11632024-11-25T19:31:30.222ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11642024-11-25T19:31:30.318ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11652024-11-25T19:31:30.342ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11662024-11-25T19:31:30.362ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11672024-11-25T19:31:30.388ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11682024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11692024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11702024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11712024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11722024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11732024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11742024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11752024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11762024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11772024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11782024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11792024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11802024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11812024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11822024-11-25T19:31:30.409ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11832024-11-25T19:31:30.430ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11842024-11-25T19:31:30.430ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11852024-11-25T19:31:30.430ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b048b34a-75aa-4bad-b776-d3f8f218c18c, time_created: 2024-11-25T19:31:29.892471850Z, time_modified: 2024-11-25T19:31:29.892471850Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11862024-11-25T19:31:30.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11872024-11-25T19:31:30.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11882024-11-25T19:31:30.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11892024-11-25T19:31:30.434ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11902024-11-25T19:31:30.463ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(38711855-ef69-4d79-bb75-aebd85b1280b)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11912024-11-25T19:31:30.467ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "38711855-ef69-4d79-bb75-aebd85b1280b" error_message_internal = not found: sled with id "38711855-ef69-4d79-bb75-aebd85b1280b" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 578840 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = 5092a5c3-ca41-49c9-bac6-e263a87ac15d response_code = 404 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
11922024-11-25T19:31:30.764ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11932024-11-25T19:31:30.764ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11942024-11-25T19:31:30.765ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11952024-11-25T19:31:30.766ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11962024-11-25T19:31:30.767ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11972024-11-25T19:31:30.770ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
11982024-11-25T19:31:30.770ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11992024-11-25T19:31:32.771ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12002024-11-25T19:31:32.771ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12012024-11-25T19:31:32.773ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12022024-11-25T19:31:32.773ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12032024-11-25T19:31:32.775ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12042024-11-25T19:31:32.778ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
12052024-11-25T19:31:32.778ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, time_created: 2024-11-25T19:31:16.865486Z, time_modified: 2024-11-25T19:31:16.865486Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12062024-11-25T19:31:32.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12072024-11-25T19:31:32.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12082024-11-25T19:31:32.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12092024-11-25T19:31:32.998ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12102024-11-25T19:31:32.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12112024-11-25T19:31:32.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12122024-11-25T19:31:33.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12132024-11-25T19:31:33.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12142024-11-25T19:31:33.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12152024-11-25T19:31:33.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12162024-11-25T19:31:33.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12172024-11-25T19:31:33.022ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12182024-11-25T19:31:33.022ZDEBGnexus (dropshot_internal): updating rack subnet for rack bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12192024-11-25T19:31:33.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12202024-11-25T19:31:33.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12212024-11-25T19:31:33.028ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12222024-11-25T19:31:33.060ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12232024-11-25T19:31:33.060ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "713a0959-019f-47bb-a0c9-66ebf521b7ce", "content-length": "24", "date": "Mon, 25 Nov 2024 19:31:32 GMT"} }) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12242024-11-25T19:31:33.060ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12252024-11-25T19:31:33.060ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12262024-11-25T19:31:33.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12272024-11-25T19:31:33.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12282024-11-25T19:31:33.071ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12292024-11-25T19:31:33.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12302024-11-25T19:31:33.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12312024-11-25T19:31:33.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12322024-11-25T19:31:33.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12332024-11-25T19:31:33.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12342024-11-25T19:31:33.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12352024-11-25T19:31:33.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12362024-11-25T19:31:33.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12372024-11-25T19:31:33.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12382024-11-25T19:31:33.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12392024-11-25T19:31:33.204ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12402024-11-25T19:31:33.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12412024-11-25T19:31:33.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12422024-11-25T19:31:33.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12432024-11-25T19:31:33.208ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12442024-11-25T19:31:33.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12452024-11-25T19:31:33.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12462024-11-25T19:31:33.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12472024-11-25T19:31:33.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12482024-11-25T19:31:33.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12492024-11-25T19:31:33.213ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = IpPool { parent: Fleet, key: d3ec4b13-a602-4bf3-88ba-c1399c028072, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12502024-11-25T19:31:33.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12512024-11-25T19:31:33.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12522024-11-25T19:31:33.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12532024-11-25T19:31:33.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12542024-11-25T19:31:33.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12552024-11-25T19:31:33.217ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = IpPool { parent: Fleet, key: d3ec4b13-a602-4bf3-88ba-c1399c028072, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12562024-11-25T19:31:33.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12572024-11-25T19:31:33.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12582024-11-25T19:31:33.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12592024-11-25T19:31:33.225ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = BlueprintConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12602024-11-25T19:31:33.238ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = c0042f8f-3059-4f90-9d41-8b34f2747978 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12612024-11-25T19:31:33.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12622024-11-25T19:31:33.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12632024-11-25T19:31:33.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12642024-11-25T19:31:33.241ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = BlueprintConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12652024-11-25T19:31:33.245ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12662024-11-25T19:31:33.245ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12672024-11-25T19:31:33.245ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12682024-11-25T19:31:33.245ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12692024-11-25T19:31:33.245ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12702024-11-25T19:31:33.245ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12712024-11-25T19:31:33.245ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12722024-11-25T19:31:33.245ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12732024-11-25T19:31:33.266ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12742024-11-25T19:31:33.291ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12752024-11-25T19:31:33.313ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12762024-11-25T19:31:33.336ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12772024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12782024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12792024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12802024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12812024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12822024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12832024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12842024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12852024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12862024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12872024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12882024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12892024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12902024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12912024-11-25T19:31:33.357ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12922024-11-25T19:31:33.383ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12932024-11-25T19:31:33.383ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12942024-11-25T19:31:33.383ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b048b34a-75aa-4bad-b776-d3f8f218c18c, time_created: 2024-11-25T19:31:32.998416828Z, time_modified: 2024-11-25T19:31:32.998416828Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12952024-11-25T19:31:33.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12962024-11-25T19:31:33.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12972024-11-25T19:31:33.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12982024-11-25T19:31:33.387ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
12992024-11-25T19:31:33.393ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 0a9b02ad-f3c2-4ceb-8b34-b3ac669cdd52, time_created: 2024-11-25T19:31:32.998417178Z, time_modified: 2024-11-25T19:31:32.998417178Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13002024-11-25T19:31:33.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13012024-11-25T19:31:33.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13022024-11-25T19:31:33.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13032024-11-25T19:31:33.397ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13042024-11-25T19:31:33.400ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: ca291b27-d496-4732-9f3e-f8baceb32d76, time_created: 2024-11-25T19:31:32.998417258Z, time_modified: 2024-11-25T19:31:32.998417258Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13052024-11-25T19:31:33.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13062024-11-25T19:31:33.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13072024-11-25T19:31:33.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13082024-11-25T19:31:33.403ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13092024-11-25T19:31:33.407ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 861dcc11-e75f-4cc1-8062-54d454843acc, time_created: 2024-11-25T19:31:32.998417338Z, time_modified: 2024-11-25T19:31:32.998417338Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13102024-11-25T19:31:33.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13112024-11-25T19:31:33.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13122024-11-25T19:31:33.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13132024-11-25T19:31:33.410ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13142024-11-25T19:31:33.414ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: d6301858-b1fb-4502-9b27-568c6acf5c62, time_created: 2024-11-25T19:31:32.998417408Z, time_modified: 2024-11-25T19:31:32.998417408Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13152024-11-25T19:31:33.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13162024-11-25T19:31:33.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13172024-11-25T19:31:33.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13182024-11-25T19:31:33.417ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13192024-11-25T19:31:33.421ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 789102d9-c835-48c4-9911-5ca432cdc4ab, time_created: 2024-11-25T19:31:32.998417488Z, time_modified: 2024-11-25T19:31:32.998417488Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13202024-11-25T19:31:33.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13212024-11-25T19:31:33.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13222024-11-25T19:31:33.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13232024-11-25T19:31:33.424ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13242024-11-25T19:31:33.427ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 2dee4fa6-735b-45e2-9555-b16c367d283b, time_created: 2024-11-25T19:31:32.998417568Z, time_modified: 2024-11-25T19:31:32.998417568Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13252024-11-25T19:31:33.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13262024-11-25T19:31:33.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13272024-11-25T19:31:33.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13282024-11-25T19:31:33.430ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13292024-11-25T19:31:33.433ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f70fc958-8475-41a9-ad11-f0e856a00356, time_created: 2024-11-25T19:31:32.998417648Z, time_modified: 2024-11-25T19:31:32.998417648Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13302024-11-25T19:31:33.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13312024-11-25T19:31:33.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13322024-11-25T19:31:33.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13332024-11-25T19:31:33.437ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13342024-11-25T19:31:33.440ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 473ba020-9209-4a1b-8931-1b190b0a7a71, time_created: 2024-11-25T19:31:32.998417728Z, time_modified: 2024-11-25T19:31:32.998417728Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2", variant: U2, sled_id: 38711855-ef69-4d79-bb75-aebd85b1280b, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13352024-11-25T19:31:33.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13362024-11-25T19:31:33.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13372024-11-25T19:31:33.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13382024-11-25T19:31:33.444ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13392024-11-25T19:31:33.448ZINFOnexus (dropshot_internal): Inserted physical disks actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:823 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13402024-11-25T19:31:33.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13412024-11-25T19:31:33.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13422024-11-25T19:31:33.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13432024-11-25T19:31:33.451ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13442024-11-25T19:31:33.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13452024-11-25T19:31:33.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13462024-11-25T19:31:33.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13472024-11-25T19:31:33.460ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13482024-11-25T19:31:33.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13492024-11-25T19:31:33.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13502024-11-25T19:31:33.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13512024-11-25T19:31:33.467ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13522024-11-25T19:31:33.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13532024-11-25T19:31:33.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13542024-11-25T19:31:33.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13552024-11-25T19:31:33.473ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13562024-11-25T19:31:33.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13572024-11-25T19:31:33.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13582024-11-25T19:31:33.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13592024-11-25T19:31:33.480ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13602024-11-25T19:31:33.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13612024-11-25T19:31:33.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13622024-11-25T19:31:33.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13632024-11-25T19:31:33.487ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13642024-11-25T19:31:33.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13652024-11-25T19:31:33.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13662024-11-25T19:31:33.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13672024-11-25T19:31:33.494ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13682024-11-25T19:31:33.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13692024-11-25T19:31:33.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13702024-11-25T19:31:33.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13712024-11-25T19:31:33.500ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13722024-11-25T19:31:33.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13732024-11-25T19:31:33.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13742024-11-25T19:31:33.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13752024-11-25T19:31:33.507ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13762024-11-25T19:31:33.511ZINFOnexus (dropshot_internal): Inserted zpools actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:835 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13772024-11-25T19:31:33.782ZINFOnexus (dropshot_internal): Inserted datasets actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:865 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13782024-11-25T19:31:33.797ZINFOnexus (dropshot_internal): Populated DNS tables for internal DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:876 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13792024-11-25T19:31:33.800ZINFOnexus (dropshot_internal): Populated DNS tables for external DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:885 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13802024-11-25T19:31:33.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13812024-11-25T19:31:33.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13822024-11-25T19:31:33.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13832024-11-25T19:31:33.803ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13842024-11-25T19:31:33.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13852024-11-25T19:31:33.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13862024-11-25T19:31:33.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13872024-11-25T19:31:33.806ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13882024-11-25T19:31:33.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13892024-11-25T19:31:33.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13902024-11-25T19:31:33.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13912024-11-25T19:31:33.864ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = DnsConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13922024-11-25T19:31:33.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13932024-11-25T19:31:33.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13942024-11-25T19:31:33.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13952024-11-25T19:31:33.868ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = DnsConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13962024-11-25T19:31:33.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13972024-11-25T19:31:33.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13982024-11-25T19:31:33.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
13992024-11-25T19:31:33.874ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = DnsConfig result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14002024-11-25T19:31:33.889ZINFOnexus (dropshot_internal): Created recovery silo actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14012024-11-25T19:31:33.903ZINFOnexus (dropshot_internal): Created recovery user actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:467 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14022024-11-25T19:31:33.910ZINFOnexus (dropshot_internal): Created recovery user's password actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:481 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14032024-11-25T19:31:33.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14042024-11-25T19:31:33.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14052024-11-25T19:31:33.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14062024-11-25T19:31:33.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14072024-11-25T19:31:33.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14082024-11-25T19:31:33.914ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14092024-11-25T19:31:33.914ZDEBGnexus (dropshot_internal): Generated role assignment queries actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14102024-11-25T19:31:33.918ZINFOnexus (dropshot_internal): Granted Silo privileges actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14112024-11-25T19:31:33.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14122024-11-25T19:31:33.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14132024-11-25T19:31:33.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14142024-11-25T19:31:33.921ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14152024-11-25T19:31:33.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14162024-11-25T19:31:33.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14172024-11-25T19:31:33.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14182024-11-25T19:31:33.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14192024-11-25T19:31:33.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14202024-11-25T19:31:33.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14212024-11-25T19:31:33.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14222024-11-25T19:31:33.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14232024-11-25T19:31:33.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14242024-11-25T19:31:33.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14252024-11-25T19:31:33.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14262024-11-25T19:31:33.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14272024-11-25T19:31:33.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14282024-11-25T19:31:33.949ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14292024-11-25T19:31:33.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14302024-11-25T19:31:33.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14312024-11-25T19:31:33.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14322024-11-25T19:31:33.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14332024-11-25T19:31:33.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14342024-11-25T19:31:33.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14352024-11-25T19:31:33.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14362024-11-25T19:31:33.957ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14372024-11-25T19:31:33.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14382024-11-25T19:31:33.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14392024-11-25T19:31:33.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14402024-11-25T19:31:33.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14412024-11-25T19:31:33.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14422024-11-25T19:31:33.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14432024-11-25T19:31:33.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14442024-11-25T19:31:33.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14452024-11-25T19:31:33.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14462024-11-25T19:31:33.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14472024-11-25T19:31:33.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14482024-11-25T19:31:33.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14492024-11-25T19:31:33.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14502024-11-25T19:31:33.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14512024-11-25T19:31:33.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14522024-11-25T19:31:33.974ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14532024-11-25T19:31:33.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14542024-11-25T19:31:33.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14552024-11-25T19:31:33.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14562024-11-25T19:31:33.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14572024-11-25T19:31:33.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14582024-11-25T19:31:33.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14592024-11-25T19:31:33.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14602024-11-25T19:31:33.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14612024-11-25T19:31:33.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14622024-11-25T19:31:33.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14632024-11-25T19:31:33.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14642024-11-25T19:31:33.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14652024-11-25T19:31:33.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14662024-11-25T19:31:33.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14672024-11-25T19:31:33.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14682024-11-25T19:31:33.992ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14692024-11-25T19:31:33.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14702024-11-25T19:31:33.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14712024-11-25T19:31:33.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14722024-11-25T19:31:33.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14732024-11-25T19:31:33.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14742024-11-25T19:31:33.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14752024-11-25T19:31:33.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14762024-11-25T19:31:34.000ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14772024-11-25T19:31:34.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14782024-11-25T19:31:34.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14792024-11-25T19:31:34.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14802024-11-25T19:31:34.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14812024-11-25T19:31:34.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14822024-11-25T19:31:34.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14832024-11-25T19:31:34.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14842024-11-25T19:31:34.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14852024-11-25T19:31:34.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14862024-11-25T19:31:34.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14872024-11-25T19:31:34.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14882024-11-25T19:31:34.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14892024-11-25T19:31:34.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14902024-11-25T19:31:34.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14912024-11-25T19:31:34.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14922024-11-25T19:31:34.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14932024-11-25T19:31:34.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14942024-11-25T19:31:34.023ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14952024-11-25T19:31:34.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14962024-11-25T19:31:34.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14972024-11-25T19:31:34.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14982024-11-25T19:31:34.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
14992024-11-25T19:31:34.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15002024-11-25T19:31:34.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15012024-11-25T19:31:34.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15022024-11-25T19:31:34.031ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15032024-11-25T19:31:34.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15042024-11-25T19:31:34.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15052024-11-25T19:31:34.037ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
15062024-11-25T19:31:34.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15072024-11-25T19:31:34.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15082024-11-25T19:31:34.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15092024-11-25T19:31:34.040ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Fleet result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15102024-11-25T19:31:34.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 roles = RoleSet { roles: {} } uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15112024-11-25T19:31:34.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 resource = Database result = Ok(()) uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15122024-11-25T19:31:34.041ZDEBGnexus: Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
15132024-11-25T19:31:34.043ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
15142024-11-25T19:31:34.043ZDEBGnexus: resolved 2 rules for sleds
15152024-11-25T19:31:34.068ZDEBGnexus: resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 38711855-ef69-4d79-bb75-aebd85b1280b, time_created: 2024-11-25T19:31:33.165388Z, time_modified: 2024-11-25T19:31:33.165388Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
15162024-11-25T19:31:34.068ZDEBGnexus: sending firewall rules to sled agents
15172024-11-25T19:31:34.068ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
15182024-11-25T19:31:34.068ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
15192024-11-25T19:31:34.071ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
15202024-11-25T19:31:34.071ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
15212024-11-25T19:31:34.073ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
15222024-11-25T19:31:34.075ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
15232024-11-25T19:31:34.105ZDEBGnexus: client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15242024-11-25T19:31:34.115ZDEBGnexus: client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "748d5700-584a-4ca0-98d0-fcba3324f1e6", "date": "Mon, 25 Nov 2024 19:31:34 GMT"} })
15252024-11-25T19:31:34.117ZINFOnexus: updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
15262024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
15272024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
15282024-11-25T19:31:34.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1122882 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33420 req_id = cb4919aa-c1c9-49fa-8aa9-dfd456b1a682 response_code = 204 uri = /racks/bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c/initialization-complete
15292024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
15302024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15312024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
15322024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
15332024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
15342024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
15352024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15362024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
15372024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15382024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15392024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15402024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15412024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15422024-11-25T19:31:34.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15432024-11-25T19:31:34.117ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1119, tv_nsec: 666230177 } })
15442024-11-25T19:31:34.117ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1119, tv_nsec: 666359380 } })
15452024-11-25T19:31:34.118ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
15462024-11-25T19:31:34.118ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 966.849\u{b5}s iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
15472024-11-25T19:31:34.118ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
15482024-11-25T19:31:34.118ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.117942ms iteration = 2 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
15492024-11-25T19:31:34.118ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15502024-11-25T19:31:34.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15512024-11-25T19:31:34.119ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15522024-11-25T19:31:34.119ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15532024-11-25T19:31:34.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15542024-11-25T19:31:34.120ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15552024-11-25T19:31:34.121ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15562024-11-25T19:31:34.121ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15572024-11-25T19:31:34.121ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15582024-11-25T19:31:34.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15592024-11-25T19:31:34.122ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
15602024-11-25T19:31:34.122ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
15612024-11-25T19:31:34.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
15622024-11-25T19:31:34.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15632024-11-25T19:31:34.126ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(4cc640c1-8be3-451a-af98-2c0913656c3d, 0), (3cff3489-5262-460c-9672-e9e1fc276c52, 0), (50f178f1-acf7-478b-9ba7-68e1b53861af, 0)]
15642024-11-25T19:31:34.126ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1119, tv_nsec: 674910368 } })
15652024-11-25T19:31:34.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15662024-11-25T19:31:34.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15672024-11-25T19:31:34.130ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15682024-11-25T19:31:34.131ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15692024-11-25T19:31:34.131ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15702024-11-25T19:31:34.131ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15712024-11-25T19:31:34.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15722024-11-25T19:31:34.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15732024-11-25T19:31:34.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15742024-11-25T19:31:34.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15752024-11-25T19:31:34.133ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15762024-11-25T19:31:34.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15772024-11-25T19:31:34.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15782024-11-25T19:31:34.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15792024-11-25T19:31:34.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15802024-11-25T19:31:34.137ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15812024-11-25T19:31:34.137ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
15822024-11-25T19:31:34.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15832024-11-25T19:31:34.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15842024-11-25T19:31:34.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15852024-11-25T19:31:34.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15862024-11-25T19:31:34.141ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15872024-11-25T19:31:34.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15882024-11-25T19:31:34.159ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
15892024-11-25T19:31:34.159ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
15902024-11-25T19:31:34.159ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
15912024-11-25T19:31:34.159ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1c4fde0-1fa5-48da-b2aa-325f15366fc1", "content-length": "476", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
15922024-11-25T19:31:34.159ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
15932024-11-25T19:31:34.159ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cecaee96-4c02-4fbe-9f6f-15ff384b33ed", "content-length": "734", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
15942024-11-25T19:31:34.159ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
15952024-11-25T19:31:34.160ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3639d14-4972-4ac0-83f3-4aba41dd1bfe", "content-length": "111", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
15962024-11-25T19:31:34.160ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
15972024-11-25T19:31:34.160ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "25766d20-9ff4-4562-905c-b31685745272", "content-length": "111", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
15982024-11-25T19:31:34.160ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
15992024-11-25T19:31:34.160ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "57fa3551-755d-4c15-a2a4-4e7941dbc3c5", "content-length": "167", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16002024-11-25T19:31:34.160ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
16012024-11-25T19:31:34.160ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "847b6220-3db0-4900-8580-d61fa8730c1a", "content-length": "167", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16022024-11-25T19:31:34.160ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
16032024-11-25T19:31:34.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d5f115b-0484-4d37-b5ff-b02760e496af", "content-length": "175", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16042024-11-25T19:31:34.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
16052024-11-25T19:31:34.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2044f4f6-a4b1-429a-b815-6bc76628e914", "content-length": "175", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16062024-11-25T19:31:34.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
16072024-11-25T19:31:34.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ef49513-c92a-498d-9353-1f4a9e351e87", "content-length": "702", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16082024-11-25T19:31:34.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
16092024-11-25T19:31:34.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b51dfee9-e12f-4feb-8b84-ba9aa79e65e7", "content-length": "727", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16102024-11-25T19:31:34.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
16112024-11-25T19:31:34.161ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd44d620-4403-4fc6-8d16-2f26ebc70dd1", "content-length": "729", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16122024-11-25T19:31:34.161ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
16132024-11-25T19:31:34.161ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
16142024-11-25T19:31:34.162ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16152024-11-25T19:31:34.162ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
16162024-11-25T19:31:34.162ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 44.685197ms iteration = 2 status = {"generation":2}
16172024-11-25T19:31:34.162ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
16182024-11-25T19:31:34.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e6f565a-7542-4e4f-98e1-51acb53f9426", "content-length": "728", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16192024-11-25T19:31:34.162ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
16202024-11-25T19:31:34.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3217f83d-9425-43b6-9509-504377b80611", "content-length": "722", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16212024-11-25T19:31:34.162ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
16222024-11-25T19:31:34.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcd4749c-8d8e-45ab-aabd-5f05a953b8c3", "content-length": "109", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16232024-11-25T19:31:34.162ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
16242024-11-25T19:31:34.162ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a7e2514-f195-40e0-bc4c-3b5988e3f781", "content-length": "109", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16252024-11-25T19:31:34.162ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
16262024-11-25T19:31:34.163ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ee8285a-5101-45cb-a345-d0fd6956fed6", "content-length": "169", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16272024-11-25T19:31:34.163ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
16282024-11-25T19:31:34.163ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e605ad67-638b-4d5a-961f-faf274611221", "content-length": "169", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16292024-11-25T19:31:34.163ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
16302024-11-25T19:31:34.163ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f38a3078-cc0e-4111-9155-c8e1d817c7f2", "content-length": "178", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16312024-11-25T19:31:34.163ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
16322024-11-25T19:31:34.163ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "81e96ce6-3578-477f-a21d-33d69749d47a", "content-length": "178", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16332024-11-25T19:31:34.163ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
16342024-11-25T19:31:34.164ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fadbd07a-f6a0-4776-a377-a07d8267d9da", "content-length": "702", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16352024-11-25T19:31:34.164ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
16362024-11-25T19:31:34.164ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5840670e-b856-40fb-a560-9203fd1dab26", "content-length": "727", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16372024-11-25T19:31:34.164ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
16382024-11-25T19:31:34.164ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "664999fa-272c-440c-a829-b46f633a4c26", "content-length": "729", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16392024-11-25T19:31:34.164ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
16402024-11-25T19:31:34.164ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "beb4a1ab-8687-40a6-b9b5-6bacdf6e6656", "content-length": "728", "date": "Mon, 25 Nov 2024 19:31:33 GMT"} })
16412024-11-25T19:31:34.164ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16422024-11-25T19:31:34.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16432024-11-25T19:31:34.166ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16442024-11-25T19:31:34.167ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16452024-11-25T19:31:34.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16462024-11-25T19:31:34.167ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
16472024-11-25T19:31:34.168ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16482024-11-25T19:31:34.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16492024-11-25T19:31:34.168ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16502024-11-25T19:31:34.169ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16512024-11-25T19:31:34.170ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16522024-11-25T19:31:34.170ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16532024-11-25T19:31:34.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16542024-11-25T19:31:34.171ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
16552024-11-25T19:31:34.171ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16562024-11-25T19:31:34.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16572024-11-25T19:31:34.193ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16582024-11-25T19:31:34.227ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16592024-11-25T19:31:34.252ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "bfe7ae7b-f346-4930-9fe6-9c8366e997d2", "date": "Mon, 25 Nov 2024 19:31:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16602024-11-25T19:31:34.252ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16612024-11-25T19:31:34.254ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6c5a0cd1-af51-4aef-b714-22a1d2a272f0", "date": "Mon, 25 Nov 2024 19:31:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16622024-11-25T19:31:34.254ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16632024-11-25T19:31:34.255ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16642024-11-25T19:31:34.255ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 93.191528ms iteration = 3 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16652024-11-25T19:31:34.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16662024-11-25T19:31:34.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16672024-11-25T19:31:34.265ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
16682024-11-25T19:31:34.265ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
16692024-11-25T19:31:34.292ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
16702024-11-25T19:31:34.292ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
16712024-11-25T19:31:34.292ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
16722024-11-25T19:31:34.292ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16732024-11-25T19:31:34.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16742024-11-25T19:31:34.294ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16752024-11-25T19:31:34.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16762024-11-25T19:31:34.296ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16772024-11-25T19:31:34.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16782024-11-25T19:31:34.299ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
16792024-11-25T19:31:34.299ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
16802024-11-25T19:31:34.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16812024-11-25T19:31:34.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16822024-11-25T19:31:34.300ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16832024-11-25T19:31:34.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16842024-11-25T19:31:34.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16852024-11-25T19:31:34.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16862024-11-25T19:31:34.307ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
16872024-11-25T19:31:34.308ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
16882024-11-25T19:31:34.308ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
16892024-11-25T19:31:34.308ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 190.62406ms iteration = 2 status = {"generation":1}
16902024-11-25T19:31:34.308ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
16912024-11-25T19:31:34.310ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
16922024-11-25T19:31:34.310ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 193.532747ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16932024-11-25T19:31:34.338ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16942024-11-25T19:31:34.370ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16952024-11-25T19:31:34.403ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16962024-11-25T19:31:34.427ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b06789eb-7fe3-46e3-b438-43de7b1ed571", "date": "Mon, 25 Nov 2024 19:31:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16972024-11-25T19:31:34.427ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16982024-11-25T19:31:34.434ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1dd37114-de86-4597-8a5b-87470369cb4d", "date": "Mon, 25 Nov 2024 19:31:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
16992024-11-25T19:31:34.434ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17002024-11-25T19:31:34.435ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3fb2d0e9-8f28-4695-a8f9-7319bb644ba9", "date": "Mon, 25 Nov 2024 19:31:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17012024-11-25T19:31:34.435ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17022024-11-25T19:31:34.437ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17032024-11-25T19:31:34.437ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 129.128743ms iteration = 3 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17042024-11-25T19:31:34.474ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "611c6461-1fc7-4bc6-8081-79d090325b08", "content-length": "30747", "date": "Mon, 25 Nov 2024 19:31:34 GMT"} })
17052024-11-25T19:31:34.476ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
17062024-11-25T19:31:34.476ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
17072024-11-25T19:31:34.476ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
17082024-11-25T19:31:34.478ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17092024-11-25T19:31:34.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17102024-11-25T19:31:34.480ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17112024-11-25T19:31:34.482ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
17122024-11-25T19:31:34.482ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17132024-11-25T19:31:34.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17142024-11-25T19:31:34.571ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 22dda696-7685-4d0a-9656-e52449f525ae file = nexus/db-queries/src/db/datastore/inventory.rs:1000
17152024-11-25T19:31:34.571ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 22dda696-7685-4d0a-9656-e52449f525ae time_started = 2024-11-25 19:31:34.159074 UTC
17162024-11-25T19:31:34.571ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 454.11124ms iteration = 2 status = {"collection_id":"22dda696-7685-4d0a-9656-e52449f525ae","time_done":"2024-11-25 19:31:34.476707 UTC","time_started":"2024-11-25 19:31:34.159074 UTC"}
17172024-11-25T19:31:34.571ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
17182024-11-25T19:31:34.571ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17192024-11-25T19:31:34.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17202024-11-25T19:31:34.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17212024-11-25T19:31:34.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17222024-11-25T19:31:34.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17232024-11-25T19:31:34.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17242024-11-25T19:31:34.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17252024-11-25T19:31:34.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17262024-11-25T19:31:34.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17272024-11-25T19:31:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17282024-11-25T19:31:34.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17292024-11-25T19:31:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17302024-11-25T19:31:34.608ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 36.583478ms iteration = 3 status = {"physical_disks_added":0}
17312024-11-25T19:31:34.778ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
17322024-11-25T19:31:34.778ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
17332024-11-25T19:31:34.779ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
17342024-11-25T19:31:34.779ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
17352024-11-25T19:31:34.781ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17362024-11-25T19:31:34.783ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, lookup_type: ById(bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c) } result = Ok(())
17372024-11-25T19:31:34.783ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
17382024-11-25T19:31:34.783ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17392024-11-25T19:31:34.783ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17402024-11-25T19:31:34.787ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17412024-11-25T19:31:34.788ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17422024-11-25T19:31:34.789ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17432024-11-25T19:31:34.789ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17442024-11-25T19:31:34.791ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17452024-11-25T19:31:34.791ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17462024-11-25T19:31:34.792ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17472024-11-25T19:31:34.792ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17482024-11-25T19:31:34.794ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17492024-11-25T19:31:34.794ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17502024-11-25T19:31:34.795ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17512024-11-25T19:31:34.798ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
17522024-11-25T19:31:34.798ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17532024-11-25T19:31:34.798ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17542024-11-25T19:31:34.799ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17552024-11-25T19:31:34.799ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17562024-11-25T19:31:34.801ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17572024-11-25T19:31:34.801ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17582024-11-25T19:31:34.802ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17592024-11-25T19:31:34.805ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
17602024-11-25T19:31:34.805ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17612024-11-25T19:31:34.805ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17622024-11-25T19:31:34.807ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17632024-11-25T19:31:34.807ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17642024-11-25T19:31:34.808ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17652024-11-25T19:31:34.809ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17662024-11-25T19:31:34.810ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17672024-11-25T19:31:34.810ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17682024-11-25T19:31:34.811ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17692024-11-25T19:31:34.811ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17702024-11-25T19:31:34.812ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17712024-11-25T19:31:34.812ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17722024-11-25T19:31:34.813ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17732024-11-25T19:31:34.814ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17742024-11-25T19:31:34.815ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17752024-11-25T19:31:34.818ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
17762024-11-25T19:31:34.818ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17772024-11-25T19:31:34.818ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17782024-11-25T19:31:34.819ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17792024-11-25T19:31:34.819ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17802024-11-25T19:31:34.820ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17812024-11-25T19:31:34.820ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17822024-11-25T19:31:34.822ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17832024-11-25T19:31:34.822ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17842024-11-25T19:31:34.824ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17852024-11-25T19:31:34.824ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17862024-11-25T19:31:34.825ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17872024-11-25T19:31:34.825ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17882024-11-25T19:31:34.826ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17892024-11-25T19:31:34.826ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17902024-11-25T19:31:34.827ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17912024-11-25T19:31:34.830ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
17922024-11-25T19:31:34.830ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17932024-11-25T19:31:34.831ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17942024-11-25T19:31:34.832ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17952024-11-25T19:31:34.832ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17962024-11-25T19:31:34.833ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
17972024-11-25T19:31:34.833ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
17982024-11-25T19:31:34.834ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17992024-11-25T19:31:34.837ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
18002024-11-25T19:31:34.838ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18012024-11-25T19:31:34.838ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18022024-11-25T19:31:34.841ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18032024-11-25T19:31:34.841ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18042024-11-25T19:31:34.842ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18052024-11-25T19:31:34.843ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18062024-11-25T19:31:34.843ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18072024-11-25T19:31:34.844ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18082024-11-25T19:31:34.845ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18092024-11-25T19:31:34.845ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18102024-11-25T19:31:34.846ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18112024-11-25T19:31:34.846ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18122024-11-25T19:31:34.847ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18132024-11-25T19:31:34.847ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18142024-11-25T19:31:34.848ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18152024-11-25T19:31:34.848ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18162024-11-25T19:31:34.849ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18172024-11-25T19:31:34.852ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
18182024-11-25T19:31:34.852ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18192024-11-25T19:31:34.853ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18202024-11-25T19:31:34.854ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18212024-11-25T19:31:34.854ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18222024-11-25T19:31:34.855ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18232024-11-25T19:31:34.855ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18242024-11-25T19:31:34.856ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18252024-11-25T19:31:34.859ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
18262024-11-25T19:31:34.859ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18272024-11-25T19:31:34.859ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18282024-11-25T19:31:34.864ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
18292024-11-25T19:31:34.864ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18302024-11-25T19:31:34.864ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18312024-11-25T19:31:34.865ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18322024-11-25T19:31:34.866ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
18332024-11-25T19:31:34.866ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18342024-11-25T19:31:34.866ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18352024-11-25T19:31:34.867ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
18362024-11-25T19:31:34.867ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
18372024-11-25T19:31:34.867ZDEBGnexus (InternalApi): resolved 2 rules for sleds
18382024-11-25T19:31:34.883ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 38711855-ef69-4d79-bb75-aebd85b1280b, time_created: 2024-11-25T19:31:33.165388Z, time_modified: 2024-11-25T19:31:33.165388Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
18392024-11-25T19:31:34.883ZDEBGnexus (InternalApi): sending firewall rules to sled agents
18402024-11-25T19:31:34.883ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18412024-11-25T19:31:34.884ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18422024-11-25T19:31:34.885ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18432024-11-25T19:31:34.885ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18442024-11-25T19:31:34.886ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18452024-11-25T19:31:34.889ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
18462024-11-25T19:31:34.919ZDEBGnexus (InternalApi): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18472024-11-25T19:31:34.919ZDEBGnexus (InternalApi): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "06de0c69-39f0-4295-9437-6bd0327351e2", "date": "Mon, 25 Nov 2024 19:31:34 GMT"} })
18482024-11-25T19:31:34.920ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
18492024-11-25T19:31:34.920ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
18502024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = / versions = all
18512024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access versions = all
18522024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path} versions = all
18532024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth versions = all
18542024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm versions = all
18552024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success versions = all
18562024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token versions = all
18572024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify versions = all
18582024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes versions = all
18592024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes versions = all
18602024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
18612024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe} versions = all
18622024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images versions = all
18632024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login versions = all
18642024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local versions = all
18652024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
18662024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
18672024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
18682024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path} versions = all
18692024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path} versions = all
18702024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new versions = all
18712024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path} versions = all
18722024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path} versions = all
18732024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization versions = all
18742024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates versions = all
18752024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates versions = all
18762024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate} versions = all
18772024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate} versions = all
18782024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks versions = all
18792024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks versions = all
18802024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk} versions = all
18812024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk} versions = all
18822024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
18832024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
18842024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
18852024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize versions = all
18862024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
18872024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips versions = all
18882024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips versions = all
18892024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
18902024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
18912024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
18922024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
18932024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
18942024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups versions = all
18952024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id} versions = all
18962024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images versions = all
18972024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images versions = all
18982024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image} versions = all
18992024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image} versions = all
19002024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote versions = all
19012024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote versions = all
19022024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances versions = all
19032024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances versions = all
19042024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance} versions = all
19052024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance} versions = all
19062024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/instances/{instance} versions = all
19072024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks versions = all
19082024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
19092024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
19102024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
19112024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
19122024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
19132024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot versions = all
19142024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
19152024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
19162024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
19172024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start versions = all
19182024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop versions = all
19192024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
19202024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
19212024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
19222024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
19232024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
19242024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
19252024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways versions = all
19262024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateways versions = all
19272024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
19282024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
19292024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools versions = all
19302024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool} versions = all
19312024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local versions = all
19322024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout versions = all
19332024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me versions = all
19342024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups versions = all
19352024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys versions = all
19362024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys versions = all
19372024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
19382024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
19392024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name} versions = all
19402024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces versions = all
19412024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces versions = all
19422024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
19432024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface} versions = all
19442024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
19452024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping versions = all
19462024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy versions = all
19472024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy versions = all
19482024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects versions = all
19492024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects versions = all
19502024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project} versions = all
19512024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project} versions = all
19522024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project} versions = all
19532024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy versions = all
19542024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy versions = all
19552024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots versions = all
19562024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots versions = all
19572024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
19582024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot} versions = all
19592024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks versions = all
19602024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
19612024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks versions = all
19622024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
19632024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds versions = all
19642024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds versions = all
19652024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
19662024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
19672024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
19682024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
19692024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
19702024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port versions = all
19712024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
19722024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
19732024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
19742024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches versions = all
19752024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
19762024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers versions = all
19772024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users versions = all
19782024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
19792024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
19802024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml versions = all
19812024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
19822024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools versions = all
19832024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools versions = all
19842024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
19852024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
19862024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
19872024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
19882024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
19892024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
19902024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
19912024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
19922024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
19932024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
19942024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
19952024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service versions = all
19962024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
19972024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
19982024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
19992024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
20002024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot versions = all
20012024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot versions = all
20022024-11-25T19:31:34.930ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
20032024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
20042024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list versions = all
20052024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list versions = all
20062024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable versions = all
20072024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable versions = all
20082024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status versions = all
20092024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp versions = all
20102024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp versions = all
20112024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp versions = all
20122024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
20132024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
20142024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
20152024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
20162024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-exported versions = all
20172024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
20182024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
20192024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status versions = all
20202024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address versions = all
20212024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address versions = all
20222024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
20232024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
20242024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
20252024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
20262024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
20272024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy versions = all
20282024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy versions = all
20292024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles versions = all
20302024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name} versions = all
20312024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas versions = all
20322024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos versions = all
20332024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos versions = all
20342024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo} versions = all
20352024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo} versions = all
20362024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
20372024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
20382024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
20392024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
20402024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
20412024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/timeseries/query versions = all
20422024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/timeseries/schemas versions = all
20432024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository versions = all
20442024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
20452024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users versions = all
20462024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id} versions = all
20472024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin versions = all
20482024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user} versions = all
20492024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos versions = all
20502024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
20512024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users versions = all
20522024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization versions = all
20532024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules versions = all
20542024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules versions = all
20552024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes versions = all
20562024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes versions = all
20572024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
20582024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
20592024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
20602024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers versions = all
20612024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers versions = all
20622024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
20632024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router} versions = all
20642024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router} versions = all
20652024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets versions = all
20662024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets versions = all
20672024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
20682024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
20692024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
20702024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
20712024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs versions = all
20722024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs versions = all
20732024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
20742024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc} versions = all
20752024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc} versions = all
20762024-11-25T19:31:34.931ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.6:443
20772024-11-25T19:31:34.931ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
20782024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = / versions = all
20792024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access versions = all
20802024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path} versions = all
20812024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth versions = all
20822024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm versions = all
20832024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success versions = all
20842024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token versions = all
20852024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify versions = all
20862024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes versions = all
20872024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes versions = all
20882024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
20892024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
20902024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images versions = all
20912024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login versions = all
20922024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local versions = all
20932024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
20942024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
20952024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
20962024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path} versions = all
20972024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path} versions = all
20982024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new versions = all
20992024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path} versions = all
21002024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path} versions = all
21012024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization versions = all
21022024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates versions = all
21032024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates versions = all
21042024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
21052024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate} versions = all
21062024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks versions = all
21072024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks versions = all
21082024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk} versions = all
21092024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk} versions = all
21102024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
21112024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
21122024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
21132024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
21142024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
21152024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips versions = all
21162024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips versions = all
21172024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
21182024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
21192024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
21202024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
21212024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
21222024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups versions = all
21232024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id} versions = all
21242024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images versions = all
21252024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images versions = all
21262024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image} versions = all
21272024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image} versions = all
21282024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote versions = all
21292024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote versions = all
21302024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances versions = all
21312024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances versions = all
21322024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance} versions = all
21332024-11-25T19:31:34.935ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance} versions = all
21342024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/instances/{instance} versions = all
21352024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
21362024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
21372024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
21382024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
21392024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21402024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21412024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
21422024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
21432024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
21442024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
21452024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start versions = all
21462024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
21472024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
21482024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
21492024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
21502024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
21512024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
21522024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
21532024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways versions = all
21542024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateways versions = all
21552024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
21562024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
21572024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools versions = all
21582024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
21592024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
21602024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout versions = all
21612024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me versions = all
21622024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups versions = all
21632024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys versions = all
21642024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys versions = all
21652024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
21662024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
21672024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
21682024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces versions = all
21692024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces versions = all
21702024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
21712024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
21722024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
21732024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping versions = all
21742024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy versions = all
21752024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy versions = all
21762024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects versions = all
21772024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects versions = all
21782024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project} versions = all
21792024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project} versions = all
21802024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project} versions = all
21812024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy versions = all
21822024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
21832024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots versions = all
21842024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots versions = all
21852024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
21862024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
21872024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks versions = all
21882024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
21892024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks versions = all
21902024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
21912024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds versions = all
21922024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds versions = all
21932024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
21942024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
21952024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
21962024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
21972024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
21982024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
21992024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
22002024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
22012024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
22022024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches versions = all
22032024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
22042024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers versions = all
22052024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
22062024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
22072024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
22082024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
22092024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
22102024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools versions = all
22112024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools versions = all
22122024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
22132024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
22142024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
22152024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
22162024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
22172024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
22182024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
22192024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
22202024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22212024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22222024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
22232024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service versions = all
22242024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
22252024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
22262024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
22272024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
22282024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot versions = all
22292024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot versions = all
22302024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
22312024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
22322024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list versions = all
22332024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
22342024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
22352024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
22362024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
22372024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
22382024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp versions = all
22392024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp versions = all
22402024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
22412024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
22422024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
22432024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
22442024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
22452024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
22462024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
22472024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
22482024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
22492024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
22502024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
22512024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
22522024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
22532024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
22542024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
22552024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy versions = all
22562024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy versions = all
22572024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles versions = all
22582024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
22592024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas versions = all
22602024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos versions = all
22612024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos versions = all
22622024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
22632024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo} versions = all
22642024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
22652024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
22662024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
22672024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
22682024-11-25T19:31:34.936ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
22692024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/timeseries/query versions = all
22702024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
22712024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository versions = all
22722024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
22732024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users versions = all
22742024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id} versions = all
22752024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin versions = all
22762024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
22772024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos versions = all
22782024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
22792024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users versions = all
22802024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization versions = all
22812024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
22822024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
22832024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes versions = all
22842024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes versions = all
22852024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
22862024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
22872024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
22882024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers versions = all
22892024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers versions = all
22902024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
22912024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
22922024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
22932024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets versions = all
22942024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets versions = all
22952024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
22962024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
22972024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
22982024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
22992024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs versions = all
23002024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs versions = all
23012024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
23022024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
23032024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
23042024-11-25T19:31:34.937ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:12228
23052024-11-25T19:31:34.937ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
23062024-11-25T19:31:34.937ZDEBGnexus (nexus-producer-server): registered DTrace probes
23072024-11-25T19:31:34.940ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:49979 method = GET path = /{producer_id} versions = all
23082024-11-25T19:31:34.940ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::b]:49979
23092024-11-25T19:31:34.940ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:49979
23102024-11-25T19:31:34.940ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:49979
23112024-11-25T19:31:34.940ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
23122024-11-25T19:31:34.940ZDEBGnexus (nexus-producer-server): starting producer registration task
23132024-11-25T19:31:34.941ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:49979 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
23142024-11-25T19:31:34.941ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
23152024-11-25T19:31:34.941ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
23162024-11-25T19:31:34.972ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
23172024-11-25T19:31:34.972ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:42114
23182024-11-25T19:31:34.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42114 req_id = 179c0ab3-57e2-409e-80ed-332600c40a3a roles = RoleSet { roles: {} } uri = /metrics/producers
23192024-11-25T19:31:34.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42114 req_id = 179c0ab3-57e2-409e-80ed-332600c40a3a resource = Database result = Ok(()) uri = /metrics/producers
23202024-11-25T19:31:35.027ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
23212024-11-25T19:31:35.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55738 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42114 req_id = 179c0ab3-57e2-409e-80ed-332600c40a3a response_code = 201 uri = /metrics/producers
23222024-11-25T19:31:35.028ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "179c0ab3-57e2-409e-80ed-332600c40a3a", "content-length": "41", "date": "Mon, 25 Nov 2024 19:31:34 GMT"} })
23232024-11-25T19:31:35.030ZDEBGnexus (producer-registration-task): registered with nexus successfully
23242024-11-25T19:31:35.030ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
23252024-11-25T19:31:36.201ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
23262024-11-25T19:31:36.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23272024-11-25T19:31:36.201ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
23282024-11-25T19:31:36.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23292024-11-25T19:31:36.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23302024-11-25T19:31:36.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23312024-11-25T19:31:36.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23322024-11-25T19:31:36.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23332024-11-25T19:31:36.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23342024-11-25T19:31:36.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23352024-11-25T19:31:36.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23362024-11-25T19:31:36.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23372024-11-25T19:31:36.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23382024-11-25T19:31:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23392024-11-25T19:31:36.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23402024-11-25T19:31:36.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
23412024-11-25T19:31:36.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23422024-11-25T19:31:36.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23432024-11-25T19:31:36.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.599051ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23442024-11-25T19:31:36.234ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
23452024-11-25T19:31:36.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.313123ms iteration = 3 status = {"enabled":false,"status":"first target blueprint","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z","time_found":"2024-11-25T19:31:36.234500469Z"}
23462024-11-25T19:31:36.234ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
23472024-11-25T19:31:36.234ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
23482024-11-25T19:31:36.234ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
23492024-11-25T19:31:36.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 5.95\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
23502024-11-25T19:31:36.234ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23512024-11-25T19:31:36.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23522024-11-25T19:31:36.234ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23532024-11-25T19:31:36.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23542024-11-25T19:31:36.234ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23552024-11-25T19:31:36.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23562024-11-25T19:31:36.235ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23572024-11-25T19:31:36.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23582024-11-25T19:31:36.235ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23592024-11-25T19:31:36.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23602024-11-25T19:31:36.236ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23612024-11-25T19:31:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23622024-11-25T19:31:36.238ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23632024-11-25T19:31:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23642024-11-25T19:31:36.238ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23652024-11-25T19:31:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23662024-11-25T19:31:36.239ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23672024-11-25T19:31:36.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23682024-11-25T19:31:36.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23692024-11-25T19:31:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23702024-11-25T19:31:36.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23712024-11-25T19:31:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23722024-11-25T19:31:36.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23732024-11-25T19:31:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23742024-11-25T19:31:36.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23752024-11-25T19:31:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23762024-11-25T19:31:36.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23772024-11-25T19:31:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23782024-11-25T19:31:36.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23792024-11-25T19:31:36.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23802024-11-25T19:31:36.275ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
23812024-11-25T19:31:36.306ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
23822024-11-25T19:31:36.336ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
23832024-11-25T19:31:36.367ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
23842024-11-25T19:31:36.400ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
23852024-11-25T19:31:37.354ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:49979 remote_addr = [fd00:1122:3344:101::d]:44910
23862024-11-25T19:31:37.356ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1166 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = c631b081-8b91-4fda-9dda-6ec2cde34bba response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
23872024-11-25T19:31:37.360ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5137ca7-45ac-4d2e-acc4-10be4e5b5a75", "content-length": "64", "date": "Mon, 25 Nov 2024 19:31:36 GMT"} })
23882024-11-25T19:31:37.360ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23892024-11-25T19:31:37.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23902024-11-25T19:31:37.361ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23912024-11-25T19:31:37.363ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23922024-11-25T19:31:37.363ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23932024-11-25T19:31:37.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23942024-11-25T19:31:37.379ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "19242369-78ca-4cf5-9f53-6a55a7cb06bd", "content-length": "64", "date": "Mon, 25 Nov 2024 19:31:36 GMT"} })
23952024-11-25T19:31:37.379ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23962024-11-25T19:31:37.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23972024-11-25T19:31:37.381ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23982024-11-25T19:31:37.382ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23992024-11-25T19:31:37.382ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24002024-11-25T19:31:37.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24012024-11-25T19:31:37.403ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "022c79ac-9c40-4b34-9f31-913e7a301377", "content-length": "64", "date": "Mon, 25 Nov 2024 19:31:36 GMT"} })
24022024-11-25T19:31:37.403ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24032024-11-25T19:31:37.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24042024-11-25T19:31:37.405ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24052024-11-25T19:31:37.406ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24062024-11-25T19:31:37.406ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24072024-11-25T19:31:37.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24082024-11-25T19:31:37.433ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "336b3ee8-e7b8-47c4-8051-b383fcf8a2aa", "content-length": "64", "date": "Mon, 25 Nov 2024 19:31:37 GMT"} })
24092024-11-25T19:31:37.433ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24102024-11-25T19:31:37.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24112024-11-25T19:31:37.435ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24122024-11-25T19:31:37.436ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24132024-11-25T19:31:37.436ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24142024-11-25T19:31:37.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24152024-11-25T19:31:37.451ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1a8cab4-dd47-4534-9d28-261cd37ea39a", "content-length": "64", "date": "Mon, 25 Nov 2024 19:31:36 GMT"} })
24162024-11-25T19:31:37.451ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24172024-11-25T19:31:37.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24182024-11-25T19:31:37.453ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24192024-11-25T19:31:37.454ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
24202024-11-25T19:31:37.454ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24212024-11-25T19:31:37.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24222024-11-25T19:31:37.462ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.228233268s iteration = 2 status = {"nsuccess":5}
24232024-11-25T19:31:37.500ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:37023
24242024-11-25T19:31:37.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37023 req_id = 2d7d4a24-f4f9-4f36-be38-99175a3b7953 roles = RoleSet { roles: {} } uri = /metrics/producers
24252024-11-25T19:31:37.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37023 req_id = 2d7d4a24-f4f9-4f36-be38-99175a3b7953 resource = Database result = Ok(()) uri = /metrics/producers
24262024-11-25T19:31:37.538ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b2b2b805-c910-42f7-8bd4-d5f05a06bed3
24272024-11-25T19:31:37.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33858 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37023 req_id = 2d7d4a24-f4f9-4f36-be38-99175a3b7953 response_code = 201 uri = /metrics/producers
24282024-11-25T19:31:38.232ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" } server_name = recovery.sys.oxide.test silo_id = d67475c9-87ae-4d90-9f64-ff01c1ac932d
24292024-11-25T19:31:38.238ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = 172.30.2.6:443 remote_addr = 10.151.1.100:62751
24302024-11-25T19:31:38.255ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24312024-11-25T19:31:38.257ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24322024-11-25T19:31:38.265ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24332024-11-25T19:31:38.265ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24342024-11-25T19:31:38.267ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24352024-11-25T19:31:38.267ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24362024-11-25T19:31:38.269ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24372024-11-25T19:31:38.270ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ByName("recovery") } result = Ok(())
24382024-11-25T19:31:38.270ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24392024-11-25T19:31:38.270ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24402024-11-25T19:31:38.272ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24412024-11-25T19:31:38.272ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24422024-11-25T19:31:38.273ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24432024-11-25T19:31:38.276ZDEBGnexus (ExternalAuthn): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ByName("recovery") } result = Ok(())
24442024-11-25T19:31:38.276ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24452024-11-25T19:31:38.276ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24462024-11-25T19:31:38.292ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24472024-11-25T19:31:38.292ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24482024-11-25T19:31:38.293ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24492024-11-25T19:31:38.294ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24502024-11-25T19:31:38.295ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24512024-11-25T19:31:38.296ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ByName("recovery") }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ByName("recovery") } result = Ok(())
24522024-11-25T19:31:38.296ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24532024-11-25T19:31:38.296ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24542024-11-25T19:31:38.980ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24552024-11-25T19:31:38.981ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24562024-11-25T19:31:38.983ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24572024-11-25T19:31:38.984ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24582024-11-25T19:31:38.986ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24592024-11-25T19:31:38.986ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24602024-11-25T19:31:38.987ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24612024-11-25T19:31:38.988ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24622024-11-25T19:31:38.989ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24632024-11-25T19:31:38.990ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
24642024-11-25T19:31:38.990ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24652024-11-25T19:31:38.991ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24662024-11-25T19:31:38.992ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24672024-11-25T19:31:38.994ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSessionList result = Ok(())
24682024-11-25T19:31:38.994ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24692024-11-25T19:31:38.994ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24702024-11-25T19:31:38.999ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 755684 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:62751 req_id = 314106dc-bf33-47c4-8a32-b9facc024e92 response_code = 204 uri = /v1/login/recovery/local
24712024-11-25T19:31:39.038ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" } server_name = recovery.sys.oxide.test silo_id = d67475c9-87ae-4d90-9f64-ff01c1ac932d
24722024-11-25T19:31:39.044ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = 172.30.2.6:443 remote_addr = 10.151.1.100:56605
24732024-11-25T19:31:39.051ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24742024-11-25T19:31:39.051ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24752024-11-25T19:31:39.060ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24762024-11-25T19:31:39.060ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24772024-11-25T19:31:39.062ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24782024-11-25T19:31:39.063ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("token = \\"6a425ceaacd773f3fd92132419b8e46d5281c01b\\"") } result = Ok(())
24792024-11-25T19:31:39.063ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24802024-11-25T19:31:39.063ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24812024-11-25T19:31:39.070ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24822024-11-25T19:31:39.070ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24832024-11-25T19:31:39.072ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24842024-11-25T19:31:39.072ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24852024-11-25T19:31:39.074ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24862024-11-25T19:31:39.074ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24872024-11-25T19:31:39.075ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24882024-11-25T19:31:39.076ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
24892024-11-25T19:31:39.076ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24902024-11-25T19:31:39.076ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24912024-11-25T19:31:39.078ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24922024-11-25T19:31:39.079ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("6a425ceaacd773f3fd92132419b8e46d5281c01b") } result = Ok(())
24932024-11-25T19:31:39.079ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24942024-11-25T19:31:39.079ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24952024-11-25T19:31:39.091ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24962024-11-25T19:31:39.091ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24972024-11-25T19:31:39.093ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24982024-11-25T19:31:39.093ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24992024-11-25T19:31:39.094ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25002024-11-25T19:31:39.094ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25012024-11-25T19:31:39.095ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25022024-11-25T19:31:39.096ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25032024-11-25T19:31:39.097ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25042024-11-25T19:31:39.098ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
25052024-11-25T19:31:39.098ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25062024-11-25T19:31:39.098ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25072024-11-25T19:31:39.100ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25082024-11-25T19:31:39.100ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25092024-11-25T19:31:39.101ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25102024-11-25T19:31:39.101ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25112024-11-25T19:31:39.102ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25122024-11-25T19:31:39.103ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(())
25132024-11-25T19:31:39.103ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56605 req_id = c50b8caf-142a-4992-b99f-6e2446c3c879 roles = RoleSet { roles: {} } uri = /v1/projects
25142024-11-25T19:31:39.104ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56605 req_id = c50b8caf-142a-4992-b99f-6e2446c3c879 resource = Database result = Ok(()) uri = /v1/projects
25152024-11-25T19:31:39.115ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56605 req_id = c50b8caf-142a-4992-b99f-6e2446c3c879 roles = RoleSet { roles: {} } uri = /v1/projects
25162024-11-25T19:31:39.115ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56605 req_id = c50b8caf-142a-4992-b99f-6e2446c3c879 resource = Database result = Ok(()) uri = /v1/projects
25172024-11-25T19:31:39.118ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56605 req_id = c50b8caf-142a-4992-b99f-6e2446c3c879 roles = RoleSet { roles: {} } uri = /v1/projects
25182024-11-25T19:31:39.118ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56605 req_id = c50b8caf-142a-4992-b99f-6e2446c3c879 resource = Database result = Ok(()) uri = /v1/projects
25192024-11-25T19:31:39.130ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56605 req_id = c50b8caf-142a-4992-b99f-6e2446c3c879 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/projects
25202024-11-25T19:31:39.131ZDEBGnexus (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56605 req_id = c50b8caf-142a-4992-b99f-6e2446c3c879 resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(()) uri = /v1/projects
25212024-11-25T19:31:39.131ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56605 req_id = c50b8caf-142a-4992-b99f-6e2446c3c879 roles = RoleSet { roles: {} } uri = /v1/projects
25222024-11-25T19:31:39.131ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56605 req_id = c50b8caf-142a-4992-b99f-6e2446c3c879 resource = Database result = Ok(()) uri = /v1/projects
25232024-11-25T19:31:39.133ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89486 local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.1.100:56605 req_id = c50b8caf-142a-4992-b99f-6e2446c3c879 response_code = 200 uri = /v1/projects
25242024-11-25T19:31:39.138ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25252024-11-25T19:31:39.138ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25262024-11-25T19:31:39.139ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25272024-11-25T19:31:39.140ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25282024-11-25T19:31:39.141ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25292024-11-25T19:31:39.142ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("token = \\"6a425ceaacd773f3fd92132419b8e46d5281c01b\\"") } result = Ok(())
25302024-11-25T19:31:39.142ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25312024-11-25T19:31:39.142ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25322024-11-25T19:31:39.144ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25332024-11-25T19:31:39.144ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25342024-11-25T19:31:39.145ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25352024-11-25T19:31:39.145ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25362024-11-25T19:31:39.147ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25372024-11-25T19:31:39.147ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25382024-11-25T19:31:39.148ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25392024-11-25T19:31:39.149ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
25402024-11-25T19:31:39.149ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25412024-11-25T19:31:39.149ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25422024-11-25T19:31:39.150ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25432024-11-25T19:31:39.152ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("6a425ceaacd773f3fd92132419b8e46d5281c01b") } result = Ok(())
25442024-11-25T19:31:39.152ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25452024-11-25T19:31:39.152ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25462024-11-25T19:31:39.155ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25472024-11-25T19:31:39.155ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25482024-11-25T19:31:39.156ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25492024-11-25T19:31:39.156ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25502024-11-25T19:31:39.158ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25512024-11-25T19:31:39.158ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25522024-11-25T19:31:39.159ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25532024-11-25T19:31:39.159ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25542024-11-25T19:31:39.160ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25552024-11-25T19:31:39.161ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
25562024-11-25T19:31:39.161ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25572024-11-25T19:31:39.161ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25582024-11-25T19:31:39.162ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25592024-11-25T19:31:39.162ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25602024-11-25T19:31:39.164ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25612024-11-25T19:31:39.164ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25622024-11-25T19:31:39.165ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25632024-11-25T19:31:39.166ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(())
25642024-11-25T19:31:39.166ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 2fc93e43-4d62-4b21-9d5f-632c5d4f837a roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
25652024-11-25T19:31:39.167ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 2fc93e43-4d62-4b21-9d5f-632c5d4f837a resource = Database result = Ok(()) uri = /v1/system/ip-pools
25662024-11-25T19:31:39.172ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 2fc93e43-4d62-4b21-9d5f-632c5d4f837a roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
25672024-11-25T19:31:39.172ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 2fc93e43-4d62-4b21-9d5f-632c5d4f837a resource = Database result = Ok(()) uri = /v1/system/ip-pools
25682024-11-25T19:31:39.175ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 2fc93e43-4d62-4b21-9d5f-632c5d4f837a roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/system/ip-pools
25692024-11-25T19:31:39.177ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 2fc93e43-4d62-4b21-9d5f-632c5d4f837a resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools
25702024-11-25T19:31:39.177ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 2fc93e43-4d62-4b21-9d5f-632c5d4f837a roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
25712024-11-25T19:31:39.177ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 2fc93e43-4d62-4b21-9d5f-632c5d4f837a resource = Database result = Ok(()) uri = /v1/system/ip-pools
25722024-11-25T19:31:39.182ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44015 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 2fc93e43-4d62-4b21-9d5f-632c5d4f837a response_code = 201 uri = /v1/system/ip-pools
25732024-11-25T19:31:39.186ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25742024-11-25T19:31:39.186ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25752024-11-25T19:31:39.188ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25762024-11-25T19:31:39.188ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25772024-11-25T19:31:39.190ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25782024-11-25T19:31:39.191ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("token = \\"6a425ceaacd773f3fd92132419b8e46d5281c01b\\"") } result = Ok(())
25792024-11-25T19:31:39.191ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25802024-11-25T19:31:39.191ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25812024-11-25T19:31:39.193ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25822024-11-25T19:31:39.193ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25832024-11-25T19:31:39.195ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25842024-11-25T19:31:39.195ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25852024-11-25T19:31:39.196ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25862024-11-25T19:31:39.196ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25872024-11-25T19:31:39.197ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25882024-11-25T19:31:39.199ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
25892024-11-25T19:31:39.199ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25902024-11-25T19:31:39.199ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25912024-11-25T19:31:39.200ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25922024-11-25T19:31:39.201ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("6a425ceaacd773f3fd92132419b8e46d5281c01b") } result = Ok(())
25932024-11-25T19:31:39.201ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25942024-11-25T19:31:39.201ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25952024-11-25T19:31:39.205ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25962024-11-25T19:31:39.205ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25972024-11-25T19:31:39.206ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25982024-11-25T19:31:39.206ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25992024-11-25T19:31:39.207ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26002024-11-25T19:31:39.208ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26012024-11-25T19:31:39.209ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26022024-11-25T19:31:39.209ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26032024-11-25T19:31:39.211ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26042024-11-25T19:31:39.212ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
26052024-11-25T19:31:39.212ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26062024-11-25T19:31:39.212ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26072024-11-25T19:31:39.213ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26082024-11-25T19:31:39.214ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26092024-11-25T19:31:39.215ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26102024-11-25T19:31:39.215ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26112024-11-25T19:31:39.216ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26122024-11-25T19:31:39.217ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(())
26132024-11-25T19:31:39.217ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26142024-11-25T19:31:39.218ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26152024-11-25T19:31:39.219ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26162024-11-25T19:31:39.219ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26172024-11-25T19:31:39.231ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26182024-11-25T19:31:39.231ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26192024-11-25T19:31:39.234ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/system/ip-pools/default/silos
26202024-11-25T19:31:39.236ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = IpPool { parent: Fleet, key: 287216fb-4c3d-4080-9cc1-6f2a65f27142, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
26212024-11-25T19:31:39.236ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26222024-11-25T19:31:39.237ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26232024-11-25T19:31:39.239ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26242024-11-25T19:31:39.239ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26252024-11-25T19:31:39.241ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26262024-11-25T19:31:39.242ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26272024-11-25T19:31:39.244ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26282024-11-25T19:31:39.245ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26292024-11-25T19:31:39.247ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26302024-11-25T19:31:39.247ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26312024-11-25T19:31:39.249ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/system/ip-pools/default/silos
26322024-11-25T19:31:39.250ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
26332024-11-25T19:31:39.250ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26342024-11-25T19:31:39.250ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26352024-11-25T19:31:39.252ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26362024-11-25T19:31:39.252ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26372024-11-25T19:31:39.255ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/system/ip-pools/default/silos
26382024-11-25T19:31:39.257ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools/default/silos
26392024-11-25T19:31:39.257ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26402024-11-25T19:31:39.257ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26412024-11-25T19:31:39.314ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129422 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 103c3fd2-128f-405a-a7a3-5cdca02f9dd7 response_code = 201 uri = /v1/system/ip-pools/default/silos
26422024-11-25T19:31:39.317ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26432024-11-25T19:31:39.317ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26442024-11-25T19:31:39.325ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26452024-11-25T19:31:39.325ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26462024-11-25T19:31:39.326ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26472024-11-25T19:31:39.327ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("token = \\"6a425ceaacd773f3fd92132419b8e46d5281c01b\\"") } result = Ok(())
26482024-11-25T19:31:39.327ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26492024-11-25T19:31:39.327ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26502024-11-25T19:31:39.329ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26512024-11-25T19:31:39.329ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26522024-11-25T19:31:39.330ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26532024-11-25T19:31:39.330ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26542024-11-25T19:31:39.331ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26552024-11-25T19:31:39.332ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26562024-11-25T19:31:39.333ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26572024-11-25T19:31:39.334ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
26582024-11-25T19:31:39.334ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26592024-11-25T19:31:39.334ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26602024-11-25T19:31:39.335ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26612024-11-25T19:31:39.336ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("6a425ceaacd773f3fd92132419b8e46d5281c01b") } result = Ok(())
26622024-11-25T19:31:39.336ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26632024-11-25T19:31:39.336ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26642024-11-25T19:31:39.340ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26652024-11-25T19:31:39.340ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26662024-11-25T19:31:39.342ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26672024-11-25T19:31:39.342ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26682024-11-25T19:31:39.343ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26692024-11-25T19:31:39.343ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26702024-11-25T19:31:39.345ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26712024-11-25T19:31:39.345ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26722024-11-25T19:31:39.346ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26732024-11-25T19:31:39.347ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
26742024-11-25T19:31:39.347ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26752024-11-25T19:31:39.347ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26762024-11-25T19:31:39.349ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26772024-11-25T19:31:39.349ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26782024-11-25T19:31:39.350ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26792024-11-25T19:31:39.350ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26802024-11-25T19:31:39.352ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26812024-11-25T19:31:39.353ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(())
26822024-11-25T19:31:39.353ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26832024-11-25T19:31:39.353ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26842024-11-25T19:31:39.355ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26852024-11-25T19:31:39.355ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26862024-11-25T19:31:39.357ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26872024-11-25T19:31:39.357ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26882024-11-25T19:31:39.359ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
26892024-11-25T19:31:39.361ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab resource = IpPool { parent: Fleet, key: 287216fb-4c3d-4080-9cc1-6f2a65f27142, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26902024-11-25T19:31:39.361ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26912024-11-25T19:31:39.361ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26922024-11-25T19:31:39.365ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26932024-11-25T19:31:39.365ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26942024-11-25T19:31:39.366ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26952024-11-25T19:31:39.366ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26962024-11-25T19:31:39.368ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
26972024-11-25T19:31:39.368ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
26982024-11-25T19:31:39.370ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
26992024-11-25T19:31:39.371ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab resource = IpPool { parent: Fleet, key: 287216fb-4c3d-4080-9cc1-6f2a65f27142, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
27002024-11-25T19:31:39.394ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79282 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = dd1fee85-217d-43dc-91a7-03b940e6b6ab response_code = 201 uri = /v1/system/ip-pools/default/ranges/add
27012024-11-25T19:31:39.398ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27022024-11-25T19:31:39.399ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27032024-11-25T19:31:39.400ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27042024-11-25T19:31:39.400ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27052024-11-25T19:31:39.401ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27062024-11-25T19:31:39.402ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("token = \\"6a425ceaacd773f3fd92132419b8e46d5281c01b\\"") } result = Ok(())
27072024-11-25T19:31:39.402ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27082024-11-25T19:31:39.402ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27092024-11-25T19:31:39.403ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27102024-11-25T19:31:39.404ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27112024-11-25T19:31:39.405ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27122024-11-25T19:31:39.405ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27132024-11-25T19:31:39.406ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27142024-11-25T19:31:39.406ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27152024-11-25T19:31:39.412ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27162024-11-25T19:31:39.413ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
27172024-11-25T19:31:39.413ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27182024-11-25T19:31:39.413ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27192024-11-25T19:31:39.414ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27202024-11-25T19:31:39.415ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("6a425ceaacd773f3fd92132419b8e46d5281c01b") } result = Ok(())
27212024-11-25T19:31:39.415ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27222024-11-25T19:31:39.415ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27232024-11-25T19:31:39.419ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27242024-11-25T19:31:39.420ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27252024-11-25T19:31:39.421ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27262024-11-25T19:31:39.421ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27272024-11-25T19:31:39.422ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27282024-11-25T19:31:39.422ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27292024-11-25T19:31:39.423ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27302024-11-25T19:31:39.424ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27312024-11-25T19:31:39.425ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27322024-11-25T19:31:39.426ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
27332024-11-25T19:31:39.426ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27342024-11-25T19:31:39.426ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27352024-11-25T19:31:39.427ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27362024-11-25T19:31:39.427ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27372024-11-25T19:31:39.429ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27382024-11-25T19:31:39.429ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27392024-11-25T19:31:39.430ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27402024-11-25T19:31:39.431ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(())
27412024-11-25T19:31:39.431ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27422024-11-25T19:31:39.431ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27432024-11-25T19:31:39.433ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27442024-11-25T19:31:39.433ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27452024-11-25T19:31:39.435ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27462024-11-25T19:31:39.435ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27472024-11-25T19:31:39.438ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27482024-11-25T19:31:39.438ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27492024-11-25T19:31:39.440ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/system/silos/recovery/quotas
27502024-11-25T19:31:39.441ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
27512024-11-25T19:31:39.441ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27522024-11-25T19:31:39.441ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27532024-11-25T19:31:39.443ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27542024-11-25T19:31:39.443ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27552024-11-25T19:31:39.445ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27562024-11-25T19:31:39.445ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27572024-11-25T19:31:39.447ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/system/silos/recovery/quotas
27582024-11-25T19:31:39.449ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
27592024-11-25T19:31:39.449ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27602024-11-25T19:31:39.449ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27612024-11-25T19:31:39.454ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57983 local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.1.100:56605 req_id = 600142bd-aec0-4bb8-b060-568f56925599 response_code = 200 uri = /v1/system/silos/recovery/quotas
27622024-11-25T19:31:39.460ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27632024-11-25T19:31:39.460ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27642024-11-25T19:31:39.462ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27652024-11-25T19:31:39.462ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27662024-11-25T19:31:39.463ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27672024-11-25T19:31:39.464ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("token = \\"6a425ceaacd773f3fd92132419b8e46d5281c01b\\"") } result = Ok(())
27682024-11-25T19:31:39.464ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27692024-11-25T19:31:39.464ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27702024-11-25T19:31:39.466ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27712024-11-25T19:31:39.466ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27722024-11-25T19:31:39.467ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27732024-11-25T19:31:39.467ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27742024-11-25T19:31:39.468ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27752024-11-25T19:31:39.469ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27762024-11-25T19:31:39.470ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27772024-11-25T19:31:39.471ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
27782024-11-25T19:31:39.471ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27792024-11-25T19:31:39.471ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27802024-11-25T19:31:39.472ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27812024-11-25T19:31:39.473ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("6a425ceaacd773f3fd92132419b8e46d5281c01b") } result = Ok(())
27822024-11-25T19:31:39.473ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27832024-11-25T19:31:39.473ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27842024-11-25T19:31:39.480ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27852024-11-25T19:31:39.480ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27862024-11-25T19:31:39.482ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27872024-11-25T19:31:39.482ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27882024-11-25T19:31:39.483ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27892024-11-25T19:31:39.483ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27902024-11-25T19:31:39.484ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27912024-11-25T19:31:39.485ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27922024-11-25T19:31:39.486ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27932024-11-25T19:31:39.487ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
27942024-11-25T19:31:39.487ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27952024-11-25T19:31:39.487ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27962024-11-25T19:31:39.488ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27972024-11-25T19:31:39.488ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27982024-11-25T19:31:39.489ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27992024-11-25T19:31:39.490ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28002024-11-25T19:31:39.491ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28012024-11-25T19:31:39.492ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(())
28022024-11-25T19:31:39.492ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = cf63492b-464a-4935-b538-83b950cda61c roles = RoleSet { roles: {} } uri = /v1/projects
28032024-11-25T19:31:39.492ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = cf63492b-464a-4935-b538-83b950cda61c resource = Database result = Ok(()) uri = /v1/projects
28042024-11-25T19:31:39.494ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = cf63492b-464a-4935-b538-83b950cda61c roles = RoleSet { roles: {} } uri = /v1/projects
28052024-11-25T19:31:39.495ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = cf63492b-464a-4935-b538-83b950cda61c resource = Database result = Ok(()) uri = /v1/projects
28062024-11-25T19:31:39.496ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = cf63492b-464a-4935-b538-83b950cda61c roles = RoleSet { roles: {} } uri = /v1/projects
28072024-11-25T19:31:39.496ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = cf63492b-464a-4935-b538-83b950cda61c resource = Database result = Ok(()) uri = /v1/projects
28082024-11-25T19:31:39.499ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = cf63492b-464a-4935-b538-83b950cda61c roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/projects
28092024-11-25T19:31:39.500ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = cf63492b-464a-4935-b538-83b950cda61c resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(()) uri = /v1/projects
28102024-11-25T19:31:39.502ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create
28112024-11-25T19:31:39.504ZINFOnexus (SEC): saga create dag = {"end_node":19,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[2,3,null],[16,17,null],[18,0,null],[17,19,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","lookup_type":{"ById":"d67475c9-87ae-4d90-9f64-ff01c1ac932d"},"parent":null},"project_create":{"description":"","name":"proj-8d57965ed9f"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","silo_user_id":"b07c52d4-1b1f-4e65-80c8-8988517a418b"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"project-create","start_node":18} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28122024-11-25T19:31:39.504ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create
28132024-11-25T19:31:39.546ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create
28142024-11-25T19:31:39.546ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28152024-11-25T19:31:39.546ZDEBGnexus (SEC): saga log event new_state = N018 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28162024-11-25T19:31:39.546ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 18 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28172024-11-25T19:31:39.565ZDEBGnexus (SEC): saga log event new_state = N018 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28182024-11-25T19:31:39.565ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28192024-11-25T19:31:39.579ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28202024-11-25T19:31:39.579ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28212024-11-25T19:31:39.587ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = ProjectCreateRecord
28222024-11-25T19:31:39.587ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = ProjectCreateRecord
28232024-11-25T19:31:39.590ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = ProjectCreateRecord
28242024-11-25T19:31:39.590ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = ProjectCreateRecord
28252024-11-25T19:31:39.592ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = ProjectCreateRecord
28262024-11-25T19:31:39.592ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = ProjectCreateRecord
28272024-11-25T19:31:39.595ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = ProjectCreateRecord
28282024-11-25T19:31:39.596ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = ProjectCreateRecord
28292024-11-25T19:31:39.596ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = ProjectCreateRecord
28302024-11-25T19:31:39.597ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = ProjectCreateRecord
28312024-11-25T19:31:39.613ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28322024-11-25T19:31:39.613ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("1a21b215-9387-4301-933d-ff3b2e222168"), "name": String("proj-8d57965ed9f"), "time_created": String("2024-11-25T19:31:39.587591Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.587591Z")}, "rcgen": Number(1), "silo_id": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}]) node_id = 0 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28332024-11-25T19:31:39.617ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28342024-11-25T19:31:39.617ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28352024-11-25T19:31:39.627ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28362024-11-25T19:31:39.627ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "silo_user_id": String("b07c52d4-1b1f-4e65-80c8-8988517a418b")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd46:765e:2de4::/48"), "name": String("default")}}) node_id = 1 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28372024-11-25T19:31:39.630ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28382024-11-25T19:31:39.630ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28392024-11-25T19:31:39.634ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28402024-11-25T19:31:39.634ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28412024-11-25T19:31:39.638ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28422024-11-25T19:31:39.638ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28432024-11-25T19:31:39.642ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28442024-11-25T19:31:39.642ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")) node_id = 3 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28452024-11-25T19:31:39.648ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28462024-11-25T19:31:39.648ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28472024-11-25T19:31:39.650ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28482024-11-25T19:31:39.650ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("beab2cae-104c-4e0c-b8c2-23c5b6c72393")) node_id = 4 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28492024-11-25T19:31:39.654ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28502024-11-25T19:31:39.654ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28512024-11-25T19:31:39.657ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28522024-11-25T19:31:39.657ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ca3b6385-a02a-438c-b1b6-5d2aa46186cf")) node_id = 5 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28532024-11-25T19:31:39.661ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28542024-11-25T19:31:39.661ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28552024-11-25T19:31:39.664ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28562024-11-25T19:31:39.664ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("4769ac22-9d93-42d9-9d2c-17909a014ea3")) node_id = 6 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28572024-11-25T19:31:39.668ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28582024-11-25T19:31:39.668ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28592024-11-25T19:31:39.672ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28602024-11-25T19:31:39.672ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("0a8674db-071b-4f31-a475-0657ec4a0e5f")) node_id = 7 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28612024-11-25T19:31:39.677ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28622024-11-25T19:31:39.677ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28632024-11-25T19:31:39.682ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28642024-11-25T19:31:39.682ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a935820a-b322-47fd-b9cf-3c3223161cd7")) node_id = 8 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28652024-11-25T19:31:39.686ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28662024-11-25T19:31:39.686ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28672024-11-25T19:31:39.689ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateVpc
28682024-11-25T19:31:39.689ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateVpc
28692024-11-25T19:31:39.694ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateVpc
28702024-11-25T19:31:39.694ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateVpc
28712024-11-25T19:31:39.697ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateVpc
28722024-11-25T19:31:39.697ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateVpc
28732024-11-25T19:31:39.699ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateVpc
28742024-11-25T19:31:39.699ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateVpc
28752024-11-25T19:31:39.702ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateVpc
28762024-11-25T19:31:39.704ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") } result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateVpc
28772024-11-25T19:31:39.704ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateVpc
28782024-11-25T19:31:39.704ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateVpc
28792024-11-25T19:31:39.718ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28802024-11-25T19:31:39.718ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "name": String("default"), "time_created": String("2024-11-25T19:31:39.689270Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.689270Z")}, "ipv6_prefix": String("fd46:765e:2de4::/48"), "project_id": String("1a21b215-9387-4301-933d-ff3b2e222168"), "subnet_gen": Number(1), "system_router_id": String("beab2cae-104c-4e0c-b8c2-23c5b6c72393"), "vni": Number(6973076)}]) node_id = 9 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28812024-11-25T19:31:39.723ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28822024-11-25T19:31:39.723ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28832024-11-25T19:31:39.728ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateRouter
28842024-11-25T19:31:39.728ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateRouter
28852024-11-25T19:31:39.730ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateRouter
28862024-11-25T19:31:39.730ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateRouter
28872024-11-25T19:31:39.732ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateRouter
28882024-11-25T19:31:39.732ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateRouter
28892024-11-25T19:31:39.734ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateRouter
28902024-11-25T19:31:39.735ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateRouter
28912024-11-25T19:31:39.737ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateRouter
28922024-11-25T19:31:39.740ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") } result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateRouter
28932024-11-25T19:31:39.740ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateRouter
28942024-11-25T19:31:39.740ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateRouter
28952024-11-25T19:31:39.775ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28962024-11-25T19:31:39.775ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("beab2cae-104c-4e0c-b8c2-23c5b6c72393"), "lookup_type": Object {"ById": String("beab2cae-104c-4e0c-b8c2-23c5b6c72393")}, "parent": Object {"key": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}}}) node_id = 10 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28972024-11-25T19:31:39.781ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
28982024-11-25T19:31:39.781ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
28992024-11-25T19:31:39.789ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV4Route
29002024-11-25T19:31:39.789ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV4Route
29012024-11-25T19:31:39.792ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV4Route
29022024-11-25T19:31:39.792ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV4Route
29032024-11-25T19:31:39.795ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV4Route
29042024-11-25T19:31:39.795ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV4Route
29052024-11-25T19:31:39.798ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV4Route
29062024-11-25T19:31:39.798ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV4Route
29072024-11-25T19:31:39.800ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV4Route
29082024-11-25T19:31:39.803ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") }, key: beab2cae-104c-4e0c-b8c2-23c5b6c72393, lookup_type: ById(beab2cae-104c-4e0c-b8c2-23c5b6c72393) } result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV4Route
29092024-11-25T19:31:39.803ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV4Route
29102024-11-25T19:31:39.803ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV4Route
29112024-11-25T19:31:39.849ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
29122024-11-25T19:31:39.849ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
29132024-11-25T19:31:39.852ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
29142024-11-25T19:31:39.852ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
29152024-11-25T19:31:39.857ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV6Route
29162024-11-25T19:31:39.857ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV6Route
29172024-11-25T19:31:39.860ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV6Route
29182024-11-25T19:31:39.860ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV6Route
29192024-11-25T19:31:39.862ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV6Route
29202024-11-25T19:31:39.862ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV6Route
29212024-11-25T19:31:39.865ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV6Route
29222024-11-25T19:31:39.865ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV6Route
29232024-11-25T19:31:39.867ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV6Route
29242024-11-25T19:31:39.870ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") }, key: beab2cae-104c-4e0c-b8c2-23c5b6c72393, lookup_type: ById(beab2cae-104c-4e0c-b8c2-23c5b6c72393) } result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV6Route
29252024-11-25T19:31:39.871ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV6Route
29262024-11-25T19:31:39.871ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateV6Route
29272024-11-25T19:31:39.905ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
29282024-11-25T19:31:39.905ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
29292024-11-25T19:31:39.911ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
29302024-11-25T19:31:39.911ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
29312024-11-25T19:31:39.916ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29322024-11-25T19:31:39.917ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29332024-11-25T19:31:39.919ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29342024-11-25T19:31:39.919ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29352024-11-25T19:31:39.921ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29362024-11-25T19:31:39.922ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29372024-11-25T19:31:39.924ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29382024-11-25T19:31:39.924ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29392024-11-25T19:31:39.926ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29402024-11-25T19:31:39.929ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") } result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29412024-11-25T19:31:39.941ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29422024-11-25T19:31:39.941ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29432024-11-25T19:31:39.968ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29442024-11-25T19:31:39.968ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateSubnet
29452024-11-25T19:31:39.974ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
29462024-11-25T19:31:39.974ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("0a8674db-071b-4f31-a475-0657ec4a0e5f"), "lookup_type": Object {"ById": String("0a8674db-071b-4f31-a475-0657ec4a0e5f")}, "parent": Object {"key": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("0a8674db-071b-4f31-a475-0657ec4a0e5f"), "name": String("default"), "time_created": String("2024-11-25T19:31:39.916814Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.916814Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd46:765e:2de4::/64"), "rcgen": Number(1), "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")}]) node_id = 13 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
29472024-11-25T19:31:39.982ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
29482024-11-25T19:31:39.982ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
29492024-11-25T19:31:39.987ZDEBGnexus: default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: cff3e2a7-1d6b-4f3a-b526-7134f9c71cb3, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2024-11-25T19:31:39.987750827Z, time_modified: 2024-11-25T19:31:39.987750827Z, time_deleted: None }, vpc_id: f00628a7-3e59-4fd5-9a30-a15b6f931c75, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 66e79f43-0fb6-4a4b-a596-02aa9d79042b, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2024-11-25T19:31:39.987753317Z, time_modified: 2024-11-25T19:31:39.987753317Z, time_deleted: None }, vpc_id: f00628a7-3e59-4fd5-9a30-a15b6f931c75, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 8257973d-78c7-497d-88d7-242b0f3c9746, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2024-11-25T19:31:39.987754567Z, time_modified: 2024-11-25T19:31:39.987754567Z, time_deleted: None }, vpc_id: f00628a7-3e59-4fd5-9a30-a15b6f931c75, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
29502024-11-25T19:31:39.987ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcUpdateFirewall
29512024-11-25T19:31:39.988ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcUpdateFirewall
29522024-11-25T19:31:39.990ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcUpdateFirewall
29532024-11-25T19:31:39.990ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcUpdateFirewall
29542024-11-25T19:31:39.992ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcUpdateFirewall
29552024-11-25T19:31:39.992ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcUpdateFirewall
29562024-11-25T19:31:39.995ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcUpdateFirewall
29572024-11-25T19:31:39.995ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcUpdateFirewall
29582024-11-25T19:31:39.997ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcUpdateFirewall
29592024-11-25T19:31:40.000ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") } result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcUpdateFirewall
29602024-11-25T19:31:40.000ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcUpdateFirewall
29612024-11-25T19:31:40.000ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcUpdateFirewall
29622024-11-25T19:31:40.054ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
29632024-11-25T19:31:40.054ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("cff3e2a7-1d6b-4f3a-b526-7134f9c71cb3"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-25T19:31:39.987750827Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.987750827Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("66e79f43-0fb6-4a4b-a596-02aa9d79042b"), "name": String("allow-ssh"), "time_created": String("2024-11-25T19:31:39.987753317Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.987753317Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("8257973d-78c7-497d-88d7-242b0f3c9746"), "name": String("allow-icmp"), "time_created": String("2024-11-25T19:31:39.987754567Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.987754567Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")}]) node_id = 14 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
29642024-11-25T19:31:40.061ZDEBGnexus (SEC): saga log event new_state = N015 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
29652024-11-25T19:31:40.061ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
29662024-11-25T19:31:40.067ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29672024-11-25T19:31:40.067ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29682024-11-25T19:31:40.069ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29692024-11-25T19:31:40.070ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29702024-11-25T19:31:40.072ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29712024-11-25T19:31:40.072ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29722024-11-25T19:31:40.075ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29732024-11-25T19:31:40.075ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29742024-11-25T19:31:40.077ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29752024-11-25T19:31:40.080ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") } result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29762024-11-25T19:31:40.080ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29772024-11-25T19:31:40.080ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29782024-11-25T19:31:40.084ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29792024-11-25T19:31:40.084ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29802024-11-25T19:31:40.088ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29812024-11-25T19:31:40.088ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29822024-11-25T19:31:40.091ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29832024-11-25T19:31:40.091ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29842024-11-25T19:31:40.093ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29852024-11-25T19:31:40.093ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29862024-11-25T19:31:40.095ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29872024-11-25T19:31:40.095ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29882024-11-25T19:31:40.097ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29892024-11-25T19:31:40.097ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29902024-11-25T19:31:40.100ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29912024-11-25T19:31:40.102ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") }, key: a935820a-b322-47fd-b9cf-3c3223161cd7, lookup_type: ById(a935820a-b322-47fd-b9cf-3c3223161cd7) } result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29922024-11-25T19:31:40.102ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29932024-11-25T19:31:40.103ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcCreateGateway
29942024-11-25T19:31:40.119ZDEBGnexus (SEC): saga log event new_state = N015 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
29952024-11-25T19:31:40.119ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("a935820a-b322-47fd-b9cf-3c3223161cd7"), "lookup_type": Object {"ById": String("a935820a-b322-47fd-b9cf-3c3223161cd7")}, "parent": Object {"key": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}}}) node_id = 15 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
29962024-11-25T19:31:40.126ZDEBGnexus (SEC): saga log event new_state = N016 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
29972024-11-25T19:31:40.126ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
29982024-11-25T19:31:40.133ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
29992024-11-25T19:31:40.133ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30002024-11-25T19:31:40.134ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30012024-11-25T19:31:40.135ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30022024-11-25T19:31:40.136ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30032024-11-25T19:31:40.136ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30042024-11-25T19:31:40.137ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30052024-11-25T19:31:40.137ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30062024-11-25T19:31:40.139ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30072024-11-25T19:31:40.140ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30082024-11-25T19:31:40.141ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30092024-11-25T19:31:40.141ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30102024-11-25T19:31:40.144ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30112024-11-25T19:31:40.144ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30122024-11-25T19:31:40.146ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30132024-11-25T19:31:40.149ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ById(1a21b215-9387-4301-933d-ff3b2e222168) }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") } result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30142024-11-25T19:31:40.149ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30152024-11-25T19:31:40.149ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30162024-11-25T19:31:40.151ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30172024-11-25T19:31:40.151ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30182024-11-25T19:31:40.157ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30192024-11-25T19:31:40.157ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30202024-11-25T19:31:40.159ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30212024-11-25T19:31:40.159ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30222024-11-25T19:31:40.162ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30232024-11-25T19:31:40.165ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ById(1a21b215-9387-4301-933d-ff3b2e222168) }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") } result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30242024-11-25T19:31:40.165ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30252024-11-25T19:31:40.165ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_node = VpcNotifySleds
30262024-11-25T19:31:40.170ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
30272024-11-25T19:31:40.170ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = []
30282024-11-25T19:31:40.170ZDEBGnexus: resolved 0 rules for sleds
30292024-11-25T19:31:40.220ZDEBGnexus: resolved sleds for vpc default vpc_to_sled = []
30302024-11-25T19:31:40.220ZDEBGnexus: sending firewall rules to sled agents
30312024-11-25T19:31:40.220ZINFOnexus: updated firewall rules on 0 sleds file = nexus/networking/src/firewall_rules.rs:496
30322024-11-25T19:31:40.220ZDEBGnexus (SEC): saga log event new_state = N016 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
30332024-11-25T19:31:40.220ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
30342024-11-25T19:31:40.224ZDEBGnexus (SEC): saga log event new_state = N017 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
30352024-11-25T19:31:40.224ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
30362024-11-25T19:31:40.228ZDEBGnexus (SEC): saga log event new_state = N017 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
30372024-11-25T19:31:40.228ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
30382024-11-25T19:31:40.231ZDEBGnexus (SEC): saga log event new_state = N019 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
30392024-11-25T19:31:40.231ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 19 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
30402024-11-25T19:31:40.234ZDEBGnexus (SEC): saga log event new_state = N019 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
30412024-11-25T19:31:40.234ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
30422024-11-25T19:31:40.238ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
30432024-11-25T19:31:40.238ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
30442024-11-25T19:31:40.285ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
30452024-11-25T19:31:40.286ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29 saga_name = project-create saga_result = SagaResult { saga_id: 9be84436-91fc-4277-8bf1-e17eb446ee29, saga_log: SagaLog { saga_id: 9be84436-91fc-4277-8bf1-e17eb446ee29, unwinding: false, events: [N018 started, N018 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N019 started, N019 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("1a21b215-9387-4301-933d-ff3b2e222168"), "name": String("proj-8d57965ed9f"), "time_created": String("2024-11-25T19:31:39.587591Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.587591Z")}, "rcgen": Number(1), "silo_id": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "silo_user_id": String("b07c52d4-1b1f-4e65-80c8-8988517a418b")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd46:765e:2de4::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")), 4: Succeeded(String("beab2cae-104c-4e0c-b8c2-23c5b6c72393")), 5: Succeeded(String("ca3b6385-a02a-438c-b1b6-5d2aa46186cf")), 6: Succeeded(String("4769ac22-9d93-42d9-9d2c-17909a014ea3")), 7: Succeeded(String("0a8674db-071b-4f31-a475-0657ec4a0e5f")), 8: Succeeded(String("a935820a-b322-47fd-b9cf-3c3223161cd7")), 9: Succeeded(Array [Object {"key": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "name": String("default"), "time_created": String("2024-11-25T19:31:39.689270Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.689270Z")}, "ipv6_prefix": String("fd46:765e:2de4::/48"), "project_id": String("1a21b215-9387-4301-933d-ff3b2e222168"), "subnet_gen": Number(1), "system_router_id": String("beab2cae-104c-4e0c-b8c2-23c5b6c72393"), "vni": Number(6973076)}]), 10: Succeeded(Object {"key": String("beab2cae-104c-4e0c-b8c2-23c5b6c72393"), "lookup_type": Object {"ById": String("beab2cae-104c-4e0c-b8c2-23c5b6c72393")}, "parent": Object {"key": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}}}), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Array [Object {"key": String("0a8674db-071b-4f31-a475-0657ec4a0e5f"), "lookup_type": Object {"ById": String("0a8674db-071b-4f31-a475-0657ec4a0e5f")}, "parent": Object {"key": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("0a8674db-071b-4f31-a475-0657ec4a0e5f"), "name": String("default"), "time_created": String("2024-11-25T19:31:39.916814Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.916814Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd46:765e:2de4::/64"), "rcgen": Number(1), "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")}]), 14: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("cff3e2a7-1d6b-4f3a-b526-7134f9c71cb3"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-25T19:31:39.987750827Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.987750827Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("66e79f43-0fb6-4a4b-a596-02aa9d79042b"), "name": String("allow-ssh"), "time_created": String("2024-11-25T19:31:39.987753317Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.987753317Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("8257973d-78c7-497d-88d7-242b0f3c9746"), "name": String("allow-icmp"), "time_created": String("2024-11-25T19:31:39.987754567Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.987754567Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")}]), 15: Succeeded(Object {"key": String("a935820a-b322-47fd-b9cf-3c3223161cd7"), "lookup_type": Object {"ById": String("a935820a-b322-47fd-b9cf-3c3223161cd7")}, "parent": Object {"key": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}}}), 16: Succeeded(Null), 17: Succeeded(Null), 18: Succeeded(Null), 19: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("a935820a-b322-47fd-b9cf-3c3223161cd7"), "default_subnet_id": String("0a8674db-071b-4f31-a475-0657ec4a0e5f"), "default_v4_route_id": String("ca3b6385-a02a-438c-b1b6-5d2aa46186cf"), "default_v6_route_id": String("4769ac22-9d93-42d9-9d2c-17909a014ea3"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("cff3e2a7-1d6b-4f3a-b526-7134f9c71cb3"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-25T19:31:39.987750827Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.987750827Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("66e79f43-0fb6-4a4b-a596-02aa9d79042b"), "name": String("allow-ssh"), "time_created": String("2024-11-25T19:31:39.987753317Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.987753317Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("8257973d-78c7-497d-88d7-242b0f3c9746"), "name": String("allow-icmp"), "time_created": String("2024-11-25T19:31:39.987754567Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.987754567Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")}], "gateway": Object {"key": String("a935820a-b322-47fd-b9cf-3c3223161cd7"), "lookup_type": Object {"ById": String("a935820a-b322-47fd-b9cf-3c3223161cd7")}, "parent": Object {"key": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("1a21b215-9387-4301-933d-ff3b2e222168"), "name": String("proj-8d57965ed9f"), "time_created": String("2024-11-25T19:31:39.587591Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.587591Z")}, "rcgen": Number(1), "silo_id": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}], "route4": Null, "route6": Null, "router": Object {"key": String("beab2cae-104c-4e0c-b8c2-23c5b6c72393"), "lookup_type": Object {"ById": String("beab2cae-104c-4e0c-b8c2-23c5b6c72393")}, "parent": Object {"key": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("0a8674db-071b-4f31-a475-0657ec4a0e5f"), "lookup_type": Object {"ById": String("0a8674db-071b-4f31-a475-0657ec4a0e5f")}, "parent": Object {"key": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("0a8674db-071b-4f31-a475-0657ec4a0e5f"), "name": String("default"), "time_created": String("2024-11-25T19:31:39.916814Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:39.916814Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd46:765e:2de4::/64"), "rcgen": Number(1), "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")}], "system_router_id": String("beab2cae-104c-4e0c-b8c2-23c5b6c72393"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("1a21b215-9387-4301-933d-ff3b2e222168"), "lookup_type": Object {"ByName": String("proj-8d57965ed9f")}, "parent": Object {"key": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "lookup_type": Object {"ById": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "silo_user_id": String("b07c52d4-1b1f-4e65-80c8-8988517a418b")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd46:765e:2de4::/48"), "name": String("default")}}, "vpc_id": String("f00628a7-3e59-4fd5-9a30-a15b6f931c75")} }) }
30462024-11-25T19:31:40.286ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 829339 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = cf63492b-464a-4935-b538-83b950cda61c response_code = 201 uri = /v1/projects
30472024-11-25T19:31:40.291ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30482024-11-25T19:31:40.292ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30492024-11-25T19:31:40.293ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30502024-11-25T19:31:40.293ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30512024-11-25T19:31:40.295ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30522024-11-25T19:31:40.296ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("token = \\"6a425ceaacd773f3fd92132419b8e46d5281c01b\\"") } result = Ok(())
30532024-11-25T19:31:40.296ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30542024-11-25T19:31:40.296ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30552024-11-25T19:31:40.297ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30562024-11-25T19:31:40.297ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30572024-11-25T19:31:40.299ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30582024-11-25T19:31:40.299ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30592024-11-25T19:31:40.300ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30602024-11-25T19:31:40.300ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30612024-11-25T19:31:40.302ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30622024-11-25T19:31:40.303ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
30632024-11-25T19:31:40.303ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30642024-11-25T19:31:40.303ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30652024-11-25T19:31:40.304ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30662024-11-25T19:31:40.305ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("6a425ceaacd773f3fd92132419b8e46d5281c01b") } result = Ok(())
30672024-11-25T19:31:40.305ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30682024-11-25T19:31:40.305ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30692024-11-25T19:31:40.310ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30702024-11-25T19:31:40.310ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30712024-11-25T19:31:40.311ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30722024-11-25T19:31:40.311ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30732024-11-25T19:31:40.313ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30742024-11-25T19:31:40.313ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30752024-11-25T19:31:40.314ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30762024-11-25T19:31:40.314ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30772024-11-25T19:31:40.316ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30782024-11-25T19:31:40.317ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
30792024-11-25T19:31:40.317ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30802024-11-25T19:31:40.317ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30812024-11-25T19:31:40.318ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30822024-11-25T19:31:40.318ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30832024-11-25T19:31:40.320ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30842024-11-25T19:31:40.320ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30852024-11-25T19:31:40.321ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30862024-11-25T19:31:40.322ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(())
30872024-11-25T19:31:40.322ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-8d57965ed9f
30882024-11-25T19:31:40.322ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 resource = Database result = Ok(()) uri = /v1/disks?project=proj-8d57965ed9f
30892024-11-25T19:31:40.323ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-8d57965ed9f
30902024-11-25T19:31:40.323ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 resource = Database result = Ok(()) uri = /v1/disks?project=proj-8d57965ed9f
30912024-11-25T19:31:40.325ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-8d57965ed9f
30922024-11-25T19:31:40.325ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 resource = Database result = Ok(()) uri = /v1/disks?project=proj-8d57965ed9f
30932024-11-25T19:31:40.327ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-8d57965ed9f
30942024-11-25T19:31:40.327ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 resource = Database result = Ok(()) uri = /v1/disks?project=proj-8d57965ed9f
30952024-11-25T19:31:40.329ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-8d57965ed9f
30962024-11-25T19:31:40.330ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 resource = Database result = Ok(()) uri = /v1/disks?project=proj-8d57965ed9f
30972024-11-25T19:31:40.331ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-8d57965ed9f
30982024-11-25T19:31:40.331ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 resource = Database result = Ok(()) uri = /v1/disks?project=proj-8d57965ed9f
30992024-11-25T19:31:40.333ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/disks?project=proj-8d57965ed9f
31002024-11-25T19:31:40.335ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 resource = Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") } result = Ok(()) uri = /v1/disks?project=proj-8d57965ed9f
31012024-11-25T19:31:40.336ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create
31022024-11-25T19:31:40.336ZINFOnexus (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.create_disk_record","label":"CreateDiskRecord","name":"created_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"disk_runtime"}},{"Start":{"params":{"create_params":{"description":"","disk_source":{"block_size":512,"type":"blank"},"name":"disk-6bb1c6781a","size":1073741824},"project_id":"1a21b215-9387-4301-933d-ff3b2e222168","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","silo_user_id":"b07c52d4-1b1f-4e65-80c8-8988517a418b"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31032024-11-25T19:31:40.336ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create
31042024-11-25T19:31:40.339ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create
31052024-11-25T19:31:40.339ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31062024-11-25T19:31:40.339ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31072024-11-25T19:31:40.339ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31082024-11-25T19:31:40.344ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31092024-11-25T19:31:40.344ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31102024-11-25T19:31:40.347ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31112024-11-25T19:31:40.347ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31122024-11-25T19:31:40.350ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31132024-11-25T19:31:40.350ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ffa2079b-6062-44c0-a1f1-36200a4ea922")) node_id = 0 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31142024-11-25T19:31:40.353ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31152024-11-25T19:31:40.353ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31162024-11-25T19:31:40.356ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31172024-11-25T19:31:40.356ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")) node_id = 1 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31182024-11-25T19:31:40.360ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31192024-11-25T19:31:40.360ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31202024-11-25T19:31:40.363ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31212024-11-25T19:31:40.363ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31222024-11-25T19:31:40.364ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31232024-11-25T19:31:40.364ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31242024-11-25T19:31:40.366ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31252024-11-25T19:31:40.366ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31262024-11-25T19:31:40.368ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31272024-11-25T19:31:40.368ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31282024-11-25T19:31:40.370ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31292024-11-25T19:31:40.371ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31302024-11-25T19:31:40.373ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31312024-11-25T19:31:40.373ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31322024-11-25T19:31:40.374ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31332024-11-25T19:31:40.377ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ById(1a21b215-9387-4301-933d-ff3b2e222168) } result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31342024-11-25T19:31:40.377ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31352024-11-25T19:31:40.377ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31362024-11-25T19:31:40.379ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31372024-11-25T19:31:40.379ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31382024-11-25T19:31:40.381ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31392024-11-25T19:31:40.381ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31402024-11-25T19:31:40.384ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31412024-11-25T19:31:40.384ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31422024-11-25T19:31:40.386ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31432024-11-25T19:31:40.388ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ById(1a21b215-9387-4301-933d-ff3b2e222168) } result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31442024-11-25T19:31:40.388ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31452024-11-25T19:31:40.388ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = CreateDiskRecord
31462024-11-25T19:31:40.425ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31472024-11-25T19:31:40.425ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("ffa2079b-6062-44c0-a1f1-36200a4ea922"), "name": String("disk-6bb1c6781a"), "time_created": String("2024-11-25T19:31:40.363390Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:40.363390Z")}, "pantry_address": Null, "project_id": String("1a21b215-9387-4301-933d-ff3b2e222168"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-25T19:31:40.363389Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}) node_id = 2 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31482024-11-25T19:31:40.428ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31492024-11-25T19:31:40.428ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31502024-11-25T19:31:40.431ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = RegionsAlloc
31512024-11-25T19:31:40.431ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = RegionsAlloc
31522024-11-25T19:31:40.491ZINFOnexus (datastore): Allocated regions for volume datasets_and_regions = [(Dataset { identity: DatasetIdentity { id: 3adbd8c1-9e77-4bbb-af72-4caf06f3e837 (dataset), time_created: 2024-11-25T19:31:32.998425Z, time_modified: 2024-11-25T19:31:32.998425Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 2517e8b2-3022-4575-a6ad-4786cce7adb4, ip: Some(fd00:1122:3344:101::1a), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: c5669e3d-8fd7-4981-91dd-d9cb7359a66d, time_created: 2024-11-25T19:31:40.454147Z, time_modified: 2024-11-25T19:31:40.454147Z }, dataset_id: 3adbd8c1-9e77-4bbb-af72-4caf06f3e837 (dataset), volume_id: edb6891f-fb52-47c0-a65b-b4afe3e7e8bf, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false }), (Dataset { identity: DatasetIdentity { id: 50a26fb5-288a-48f1-b82b-229ba808f542 (dataset), time_created: 2024-11-25T19:31:32.998422Z, time_modified: 2024-11-25T19:31:32.998422Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: df57d550-ef00-4438-9a9e-b1b08bdaa525, ip: Some(fd00:1122:3344:101::19), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: 2faecc4f-d361-463e-a36b-fcca4cab1ae8, time_created: 2024-11-25T19:31:40.454147Z, time_modified: 2024-11-25T19:31:40.454147Z }, dataset_id: 50a26fb5-288a-48f1-b82b-229ba808f542 (dataset), volume_id: edb6891f-fb52-47c0-a65b-b4afe3e7e8bf, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false }), (Dataset { identity: DatasetIdentity { id: aec66277-5149-4d9c-85df-d6a30f6761a8 (dataset), time_created: 2024-11-25T19:31:32.998422Z, time_modified: 2024-11-25T19:31:32.998422Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: d7af1128-7206-4198-91cb-ef632ea8556e, ip: Some(fd00:1122:3344:101::15), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: 7ceeb083-236e-4c0d-904b-8aec992d4977, time_created: 2024-11-25T19:31:40.454147Z, time_modified: 2024-11-25T19:31:40.454147Z }, dataset_id: aec66277-5149-4d9c-85df-d6a30f6761a8 (dataset), volume_id: edb6891f-fb52-47c0-a65b-b4afe3e7e8bf, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false })] file = nexus/db-queries/src/db/datastore/region.rs:282 maybe_snapshot_id = None volume_id = edb6891f-fb52-47c0-a65b-b4afe3e7e8bf
31532024-11-25T19:31:40.491ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31542024-11-25T19:31:40.491ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("3adbd8c1-9e77-4bbb-af72-4caf06f3e837"), "time_created": String("2024-11-25T19:31:32.998425Z"), "time_modified": String("2024-11-25T19:31:32.998425Z")}, "ip": String("fd00:1122:3344:101::1a"), "kind": String("Crucible"), "pool_id": String("2517e8b2-3022-4575-a6ad-4786cce7adb4"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("3adbd8c1-9e77-4bbb-af72-4caf06f3e837"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("c5669e3d-8fd7-4981-91dd-d9cb7359a66d"), "time_created": String("2024-11-25T19:31:40.454147Z"), "time_modified": String("2024-11-25T19:31:40.454147Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}], Array [Object {"compression": Null, "identity": Object {"id": String("50a26fb5-288a-48f1-b82b-229ba808f542"), "time_created": String("2024-11-25T19:31:32.998422Z"), "time_modified": String("2024-11-25T19:31:32.998422Z")}, "ip": String("fd00:1122:3344:101::19"), "kind": String("Crucible"), "pool_id": String("df57d550-ef00-4438-9a9e-b1b08bdaa525"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("50a26fb5-288a-48f1-b82b-229ba808f542"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("2faecc4f-d361-463e-a36b-fcca4cab1ae8"), "time_created": String("2024-11-25T19:31:40.454147Z"), "time_modified": String("2024-11-25T19:31:40.454147Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}], Array [Object {"compression": Null, "identity": Object {"id": String("aec66277-5149-4d9c-85df-d6a30f6761a8"), "time_created": String("2024-11-25T19:31:32.998422Z"), "time_modified": String("2024-11-25T19:31:32.998422Z")}, "ip": String("fd00:1122:3344:101::15"), "kind": String("Crucible"), "pool_id": String("d7af1128-7206-4198-91cb-ef632ea8556e"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("aec66277-5149-4d9c-85df-d6a30f6761a8"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("7ceeb083-236e-4c0d-904b-8aec992d4977"), "time_created": String("2024-11-25T19:31:40.454147Z"), "time_modified": String("2024-11-25T19:31:40.454147Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}]]) node_id = 3 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31552024-11-25T19:31:40.496ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31562024-11-25T19:31:40.496ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31572024-11-25T19:31:40.500ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = SpaceAccount
31582024-11-25T19:31:40.501ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = SpaceAccount
31592024-11-25T19:31:40.529ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31602024-11-25T19:31:40.529ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31612024-11-25T19:31:40.532ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31622024-11-25T19:31:40.532ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31632024-11-25T19:31:40.536ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31642024-11-25T19:31:40.536ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31652024-11-25T19:31:40.540ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31662024-11-25T19:31:40.540ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31672024-11-25T19:31:40.588ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 216.922367ms dataset = 50a26fb5-288a-48f1-b82b-229ba808f542 file = nexus/src/app/crucible.rs:231 region = 2faecc4f-d361-463e-a36b-fcca4cab1ae8 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create
31682024-11-25T19:31:40.588ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 180.465336ms dataset = aec66277-5149-4d9c-85df-d6a30f6761a8 file = nexus/src/app/crucible.rs:231 region = 7ceeb083-236e-4c0d-904b-8aec992d4977 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create
31692024-11-25T19:31:40.594ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 369.887048ms dataset = 3adbd8c1-9e77-4bbb-af72-4caf06f3e837 file = nexus/src/app/crucible.rs:231 region = c5669e3d-8fd7-4981-91dd-d9cb7359a66d saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create
31702024-11-25T19:31:40.777ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 746.895149ms dataset = aec66277-5149-4d9c-85df-d6a30f6761a8 file = nexus/src/app/crucible.rs:231 region = 7ceeb083-236e-4c0d-904b-8aec992d4977 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create
31712024-11-25T19:31:40.813ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 490.572009ms dataset = 50a26fb5-288a-48f1-b82b-229ba808f542 file = nexus/src/app/crucible.rs:231 region = 2faecc4f-d361-463e-a36b-fcca4cab1ae8 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create
31722024-11-25T19:31:41.539ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31732024-11-25T19:31:41.539ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"ffa2079b-6062-44c0-a1f1-36200a4ea922\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"ffa2079b-6062-44c0-a1f1-36200a4ea922\\",\\"key\\":\\"13+Uflkz0lwuY7EDf7j5RJ356Ixgh9Xoh5zu0KdFLZg=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::1a]:19000\\",\\"[fd00:1122:3344:101::19]:19000\\",\\"[fd00:1122:3344:101::15]:19000\\"]}}]}")) node_id = 6 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31742024-11-25T19:31:41.544ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31752024-11-25T19:31:41.544ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31762024-11-25T19:31:41.572ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31772024-11-25T19:31:41.572ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31782024-11-25T19:31:41.576ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
31792024-11-25T19:31:41.576ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
31802024-11-25T19:31:41.579ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31812024-11-25T19:31:41.579ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31822024-11-25T19:31:41.581ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31832024-11-25T19:31:41.582ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31842024-11-25T19:31:41.583ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31852024-11-25T19:31:41.583ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31862024-11-25T19:31:41.585ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31872024-11-25T19:31:41.585ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31882024-11-25T19:31:41.587ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31892024-11-25T19:31:41.587ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31902024-11-25T19:31:41.589ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31912024-11-25T19:31:41.589ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31922024-11-25T19:31:41.592ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31932024-11-25T19:31:41.592ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31942024-11-25T19:31:41.594ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31952024-11-25T19:31:41.597ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ById(1a21b215-9387-4301-933d-ff3b2e222168) }, key: ffa2079b-6062-44c0-a1f1-36200a4ea922, lookup_type: ById(ffa2079b-6062-44c0-a1f1-36200a4ea922) } result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31962024-11-25T19:31:41.597ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31972024-11-25T19:31:41.597ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31982024-11-25T19:31:41.599ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
31992024-11-25T19:31:41.600ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
32002024-11-25T19:31:41.601ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
32012024-11-25T19:31:41.602ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
32022024-11-25T19:31:41.604ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
32032024-11-25T19:31:41.604ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
32042024-11-25T19:31:41.606ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
32052024-11-25T19:31:41.608ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ById(1a21b215-9387-4301-933d-ff3b2e222168) }, key: ffa2079b-6062-44c0-a1f1-36200a4ea922, lookup_type: ById(ffa2079b-6062-44c0-a1f1-36200a4ea922) } result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
32062024-11-25T19:31:41.608ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
32072024-11-25T19:31:41.609ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_node = FinalizeDiskRecord
32082024-11-25T19:31:41.629ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
32092024-11-25T19:31:41.629ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
32102024-11-25T19:31:41.633ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
32112024-11-25T19:31:41.633ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
32122024-11-25T19:31:41.636ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
32132024-11-25T19:31:41.636ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
32142024-11-25T19:31:41.639ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
32152024-11-25T19:31:41.639ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
32162024-11-25T19:31:41.647ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
32172024-11-25T19:31:41.647ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940 saga_name = disk-create saga_result = SagaResult { saga_id: 25cac5a7-37ac-4a12-b0f0-7e53c6142940, saga_log: SagaLog { saga_id: 25cac5a7-37ac-4a12-b0f0-7e53c6142940, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("ffa2079b-6062-44c0-a1f1-36200a4ea922")), 1: Succeeded(String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")), 2: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("ffa2079b-6062-44c0-a1f1-36200a4ea922"), "name": String("disk-6bb1c6781a"), "time_created": String("2024-11-25T19:31:40.363390Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:40.363390Z")}, "pantry_address": Null, "project_id": String("1a21b215-9387-4301-933d-ff3b2e222168"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-25T19:31:40.363389Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}), 3: Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("3adbd8c1-9e77-4bbb-af72-4caf06f3e837"), "time_created": String("2024-11-25T19:31:32.998425Z"), "time_modified": String("2024-11-25T19:31:32.998425Z")}, "ip": String("fd00:1122:3344:101::1a"), "kind": String("Crucible"), "pool_id": String("2517e8b2-3022-4575-a6ad-4786cce7adb4"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("3adbd8c1-9e77-4bbb-af72-4caf06f3e837"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("c5669e3d-8fd7-4981-91dd-d9cb7359a66d"), "time_created": String("2024-11-25T19:31:40.454147Z"), "time_modified": String("2024-11-25T19:31:40.454147Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}], Array [Object {"compression": Null, "identity": Object {"id": String("50a26fb5-288a-48f1-b82b-229ba808f542"), "time_created": String("2024-11-25T19:31:32.998422Z"), "time_modified": String("2024-11-25T19:31:32.998422Z")}, "ip": String("fd00:1122:3344:101::19"), "kind": String("Crucible"), "pool_id": String("df57d550-ef00-4438-9a9e-b1b08bdaa525"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("50a26fb5-288a-48f1-b82b-229ba808f542"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("2faecc4f-d361-463e-a36b-fcca4cab1ae8"), "time_created": String("2024-11-25T19:31:40.454147Z"), "time_modified": String("2024-11-25T19:31:40.454147Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}], Array [Object {"compression": Null, "identity": Object {"id": String("aec66277-5149-4d9c-85df-d6a30f6761a8"), "time_created": String("2024-11-25T19:31:32.998422Z"), "time_modified": String("2024-11-25T19:31:32.998422Z")}, "ip": String("fd00:1122:3344:101::15"), "kind": String("Crucible"), "pool_id": String("d7af1128-7206-4198-91cb-ef632ea8556e"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("aec66277-5149-4d9c-85df-d6a30f6761a8"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("7ceeb083-236e-4c0d-904b-8aec992d4977"), "time_created": String("2024-11-25T19:31:40.454147Z"), "time_modified": String("2024-11-25T19:31:40.454147Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}]]), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"ffa2079b-6062-44c0-a1f1-36200a4ea922\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"ffa2079b-6062-44c0-a1f1-36200a4ea922\\",\\"key\\":\\"13+Uflkz0lwuY7EDf7j5RJ356Ixgh9Xoh5zu0KdFLZg=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::1a]:19000\\",\\"[fd00:1122:3344:101::19]:19000\\",\\"[fd00:1122:3344:101::15]:19000\\"]}}]}")), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"created_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("ffa2079b-6062-44c0-a1f1-36200a4ea922"), "name": String("disk-6bb1c6781a"), "time_created": String("2024-11-25T19:31:40.363390Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:40.363390Z")}, "pantry_address": Null, "project_id": String("1a21b215-9387-4301-933d-ff3b2e222168"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-25T19:31:40.363389Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}, "created_volume": Null, "datasets_and_regions": Array [Array [Object {"compression": Null, "identity": Object {"id": String("3adbd8c1-9e77-4bbb-af72-4caf06f3e837"), "time_created": String("2024-11-25T19:31:32.998425Z"), "time_modified": String("2024-11-25T19:31:32.998425Z")}, "ip": String("fd00:1122:3344:101::1a"), "kind": String("Crucible"), "pool_id": String("2517e8b2-3022-4575-a6ad-4786cce7adb4"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("3adbd8c1-9e77-4bbb-af72-4caf06f3e837"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("c5669e3d-8fd7-4981-91dd-d9cb7359a66d"), "time_created": String("2024-11-25T19:31:40.454147Z"), "time_modified": String("2024-11-25T19:31:40.454147Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}], Array [Object {"compression": Null, "identity": Object {"id": String("50a26fb5-288a-48f1-b82b-229ba808f542"), "time_created": String("2024-11-25T19:31:32.998422Z"), "time_modified": String("2024-11-25T19:31:32.998422Z")}, "ip": String("fd00:1122:3344:101::19"), "kind": String("Crucible"), "pool_id": String("df57d550-ef00-4438-9a9e-b1b08bdaa525"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("50a26fb5-288a-48f1-b82b-229ba808f542"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("2faecc4f-d361-463e-a36b-fcca4cab1ae8"), "time_created": String("2024-11-25T19:31:40.454147Z"), "time_modified": String("2024-11-25T19:31:40.454147Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}], Array [Object {"compression": Null, "identity": Object {"id": String("aec66277-5149-4d9c-85df-d6a30f6761a8"), "time_created": String("2024-11-25T19:31:32.998422Z"), "time_modified": String("2024-11-25T19:31:32.998422Z")}, "ip": String("fd00:1122:3344:101::15"), "kind": String("Crucible"), "pool_id": String("d7af1128-7206-4198-91cb-ef632ea8556e"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("aec66277-5149-4d9c-85df-d6a30f6761a8"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("7ceeb083-236e-4c0d-904b-8aec992d4977"), "time_created": String("2024-11-25T19:31:40.454147Z"), "time_modified": String("2024-11-25T19:31:40.454147Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}]], "disk_id": String("ffa2079b-6062-44c0-a1f1-36200a4ea922"), "disk_runtime": Null, "no_result": Null, "regions_ensure": String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"ffa2079b-6062-44c0-a1f1-36200a4ea922\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"ffa2079b-6062-44c0-a1f1-36200a4ea922\\",\\"key\\":\\"13+Uflkz0lwuY7EDf7j5RJ356Ixgh9Xoh5zu0KdFLZg=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::1a]:19000\\",\\"[fd00:1122:3344:101::19]:19000\\",\\"[fd00:1122:3344:101::15]:19000\\"]}}]}"), "regions_ensure_undo": Null, "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")} }) }
32182024-11-25T19:31:41.647ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1359966 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 44f2ac4b-c2ec-442d-9492-9ad52c04efd2 response_code = 201 uri = /v1/disks?project=proj-8d57965ed9f
32192024-11-25T19:31:41.651ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32202024-11-25T19:31:41.651ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32212024-11-25T19:31:41.653ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32222024-11-25T19:31:41.653ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32232024-11-25T19:31:41.654ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32242024-11-25T19:31:41.655ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("token = \\"6a425ceaacd773f3fd92132419b8e46d5281c01b\\"") } result = Ok(())
32252024-11-25T19:31:41.655ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32262024-11-25T19:31:41.655ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32272024-11-25T19:31:41.657ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32282024-11-25T19:31:41.657ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32292024-11-25T19:31:41.658ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32302024-11-25T19:31:41.658ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32312024-11-25T19:31:41.659ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32322024-11-25T19:31:41.660ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32332024-11-25T19:31:41.661ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32342024-11-25T19:31:41.662ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
32352024-11-25T19:31:41.662ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32362024-11-25T19:31:41.662ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32372024-11-25T19:31:41.663ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32382024-11-25T19:31:41.664ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("6a425ceaacd773f3fd92132419b8e46d5281c01b") } result = Ok(())
32392024-11-25T19:31:41.665ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32402024-11-25T19:31:41.665ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32412024-11-25T19:31:41.668ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32422024-11-25T19:31:41.668ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32432024-11-25T19:31:41.669ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32442024-11-25T19:31:41.669ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32452024-11-25T19:31:41.670ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32462024-11-25T19:31:41.671ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32472024-11-25T19:31:41.672ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32482024-11-25T19:31:41.672ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32492024-11-25T19:31:41.673ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32502024-11-25T19:31:41.674ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
32512024-11-25T19:31:41.674ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32522024-11-25T19:31:41.674ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32532024-11-25T19:31:41.676ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32542024-11-25T19:31:41.676ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32552024-11-25T19:31:41.677ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32562024-11-25T19:31:41.677ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32572024-11-25T19:31:41.678ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32582024-11-25T19:31:41.679ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(())
32592024-11-25T19:31:41.680ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32602024-11-25T19:31:41.680ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32612024-11-25T19:31:41.681ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32622024-11-25T19:31:41.681ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32632024-11-25T19:31:41.683ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32642024-11-25T19:31:41.684ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32652024-11-25T19:31:41.686ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32662024-11-25T19:31:41.686ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32672024-11-25T19:31:41.688ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32682024-11-25T19:31:41.688ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32692024-11-25T19:31:41.690ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32702024-11-25T19:31:41.690ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32712024-11-25T19:31:41.693ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32722024-11-25T19:31:41.693ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32732024-11-25T19:31:41.695ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32742024-11-25T19:31:41.697ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: ffa2079b-6062-44c0-a1f1-36200a4ea922, lookup_type: ByName("disk-6bb1c6781a") } result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32752024-11-25T19:31:41.697ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32762024-11-25T19:31:41.698ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32772024-11-25T19:31:41.700ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32782024-11-25T19:31:41.700ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32792024-11-25T19:31:41.701ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32802024-11-25T19:31:41.701ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32812024-11-25T19:31:41.702ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32822024-11-25T19:31:41.702ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32832024-11-25T19:31:41.704ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32842024-11-25T19:31:41.704ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32852024-11-25T19:31:41.709ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32862024-11-25T19:31:41.709ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32872024-11-25T19:31:41.711ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32882024-11-25T19:31:41.711ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Database result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32892024-11-25T19:31:41.713ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32902024-11-25T19:31:41.716ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ById(1a21b215-9387-4301-933d-ff3b2e222168) }, key: ffa2079b-6062-44c0-a1f1-36200a4ea922, lookup_type: ById(ffa2079b-6062-44c0-a1f1-36200a4ea922) } result = Ok(()) uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
32912024-11-25T19:31:41.717ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete
32922024-11-25T19:31:41.717ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","silo_user_id":"b07c52d4-1b1f-4e65-80c8-8988517a418b"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"edb6891f-fb52-47c0-a65b-b4afe3e7e8bf"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"ffa2079b-6062-44c0-a1f1-36200a4ea922","project_id":"1a21b215-9387-4301-933d-ff3b2e222168","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","silo_user_id":"b07c52d4-1b1f-4e65-80c8-8988517a418b"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"edb6891f-fb52-47c0-a65b-b4afe3e7e8bf"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
32932024-11-25T19:31:41.717ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete
32942024-11-25T19:31:41.721ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete
32952024-11-25T19:31:41.721ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
32962024-11-25T19:31:41.721ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
32972024-11-25T19:31:41.721ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
32982024-11-25T19:31:41.724ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
32992024-11-25T19:31:41.724ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33002024-11-25T19:31:41.727ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33012024-11-25T19:31:41.727ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33022024-11-25T19:31:41.739ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33032024-11-25T19:31:41.739ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("ffa2079b-6062-44c0-a1f1-36200a4ea922"), "name": String("disk-6bb1c6781a"), "time_created": String("2024-11-25T19:31:40.363390Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:40.363390Z")}, "pantry_address": Null, "project_id": String("1a21b215-9387-4301-933d-ff3b2e222168"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-25T19:31:41.597394Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}) node_id = 0 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33042024-11-25T19:31:41.743ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33052024-11-25T19:31:41.743ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33062024-11-25T19:31:41.746ZDEBGnexus (SagaExecutor): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true roles = RoleSet { roles: {} } saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete saga_node = SpaceAccount
33072024-11-25T19:31:41.746ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true resource = Database result = Ok(()) saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete saga_node = SpaceAccount
33082024-11-25T19:31:41.766ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33092024-11-25T19:31:41.766ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33102024-11-25T19:31:41.770ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33112024-11-25T19:31:41.770ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33122024-11-25T19:31:41.774ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33132024-11-25T19:31:41.774ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "silo_user_id": String("b07c52d4-1b1f-4e65-80c8-8988517a418b")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}) node_id = 2 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33142024-11-25T19:31:41.777ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33152024-11-25T19:31:41.777ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33162024-11-25T19:31:41.780ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33172024-11-25T19:31:41.780ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33182024-11-25T19:31:41.784ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33192024-11-25T19:31:41.784ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33202024-11-25T19:31:41.813ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33212024-11-25T19:31:41.813ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("c5669e3d-8fd7-4981-91dd-d9cb7359a66d"), String("2faecc4f-d361-463e-a36b-fcca4cab1ae8"), String("7ceeb083-236e-4c0d-904b-8aec992d4977")]}}) node_id = 4 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33222024-11-25T19:31:41.816ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33232024-11-25T19:31:41.816ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33242024-11-25T19:31:41.819ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33252024-11-25T19:31:41.819ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33262024-11-25T19:31:41.823ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33272024-11-25T19:31:41.823ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33282024-11-25T19:31:41.854ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 87.203868ms file = nexus/src/app/crucible.rs:828 region_id = 2faecc4f-d361-463e-a36b-fcca4cab1ae8 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete
33292024-11-25T19:31:41.857ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 100.34256ms file = nexus/src/app/crucible.rs:828 region_id = 7ceeb083-236e-4c0d-904b-8aec992d4977 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete
33302024-11-25T19:31:41.857ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 142.962888ms file = nexus/src/app/crucible.rs:828 region_id = c5669e3d-8fd7-4981-91dd-d9cb7359a66d saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete
33312024-11-25T19:31:41.946ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 2faecc4f-d361-463e-a36b-fcca4cab1ae8 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete
33322024-11-25T19:31:41.962ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 7ceeb083-236e-4c0d-904b-8aec992d4977 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete
33332024-11-25T19:31:42.004ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = c5669e3d-8fd7-4981-91dd-d9cb7359a66d saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete
33342024-11-25T19:31:42.028ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33352024-11-25T19:31:42.028ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33362024-11-25T19:31:42.033ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33372024-11-25T19:31:42.033ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33382024-11-25T19:31:42.036ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33392024-11-25T19:31:42.036ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33402024-11-25T19:31:42.040ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33412024-11-25T19:31:42.040ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33422024-11-25T19:31:42.043ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33432024-11-25T19:31:42.043ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33442024-11-25T19:31:42.046ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33452024-11-25T19:31:42.046ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33462024-11-25T19:31:42.054ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33472024-11-25T19:31:42.055ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 9 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33482024-11-25T19:31:42.058ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33492024-11-25T19:31:42.058ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33502024-11-25T19:31:42.061ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33512024-11-25T19:31:42.061ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33522024-11-25T19:31:42.063ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33532024-11-25T19:31:42.063ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33542024-11-25T19:31:42.070ZINFOnexus (SagaExecutor): allocated regions for edb6891f-fb52-47c0-a65b-b4afe3e7e8bf is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:531 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete
33552024-11-25T19:31:42.074ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33562024-11-25T19:31:42.074ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33572024-11-25T19:31:42.077ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33582024-11-25T19:31:42.077ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33592024-11-25T19:31:42.080ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33602024-11-25T19:31:42.080ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33612024-11-25T19:31:42.083ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33622024-11-25T19:31:42.083ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33632024-11-25T19:31:42.086ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33642024-11-25T19:31:42.086ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33652024-11-25T19:31:42.089ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33662024-11-25T19:31:42.089ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
33672024-11-25T19:31:42.130ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete sec_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
33682024-11-25T19:31:42.130ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4 saga_name = disk-delete saga_result = SagaResult { saga_id: e13bda68-59d8-4518-9325-e38219b4fbf4, saga_log: SagaLog { saga_id: e13bda68-59d8-4518-9325-e38219b4fbf4, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N006 started, N005 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("ffa2079b-6062-44c0-a1f1-36200a4ea922"), "name": String("disk-6bb1c6781a"), "time_created": String("2024-11-25T19:31:40.363390Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:40.363390Z")}, "pantry_address": Null, "project_id": String("1a21b215-9387-4301-933d-ff3b2e222168"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-25T19:31:41.597394Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "silo_user_id": String("b07c52d4-1b1f-4e65-80c8-8988517a418b")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("c5669e3d-8fd7-4981-91dd-d9cb7359a66d"), String("2faecc4f-d361-463e-a36b-fcca4cab1ae8"), String("7ceeb083-236e-4c0d-904b-8aec992d4977")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Array []), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("c5669e3d-8fd7-4981-91dd-d9cb7359a66d"), String("2faecc4f-d361-463e-a36b-fcca4cab1ae8"), String("7ceeb083-236e-4c0d-904b-8aec992d4977")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("ffa2079b-6062-44c0-a1f1-36200a4ea922"), "name": String("disk-6bb1c6781a"), "time_created": String("2024-11-25T19:31:40.363390Z"), "time_deleted": Null, "time_modified": String("2024-11-25T19:31:40.363390Z")}, "pantry_address": Null, "project_id": String("1a21b215-9387-4301-933d-ff3b2e222168"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-25T19:31:41.597394Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}, "freed_crucible_regions": Array [], "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("d67475c9-87ae-4d90-9f64-ff01c1ac932d"), "silo_user_id": String("b07c52d4-1b1f-4e65-80c8-8988517a418b")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("edb6891f-fb52-47c0-a65b-b4afe3e7e8bf")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
33692024-11-25T19:31:42.130ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 478774 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = e53b8ac0-d0e9-474a-a73b-bbfa99d8c203 response_code = 204 uri = /v1/disks/disk-6bb1c6781a?project=proj-8d57965ed9f
33702024-11-25T19:31:42.131ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33712024-11-25T19:31:42.131ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33722024-11-25T19:31:42.133ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33732024-11-25T19:31:42.134ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = DeviceAuthRequestList result = Ok(())
33742024-11-25T19:31:42.135ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33752024-11-25T19:31:42.135ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33762024-11-25T19:31:42.144ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12859 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = cff44725-4c8a-4570-a222-39d8ebcc00f0 response_code = 200 uri = /device/auth
33772024-11-25T19:31:42.147ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33782024-11-25T19:31:42.147ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33792024-11-25T19:31:42.148ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33802024-11-25T19:31:42.148ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33812024-11-25T19:31:42.149ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33822024-11-25T19:31:42.150ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("token = \\"6a425ceaacd773f3fd92132419b8e46d5281c01b\\"") } result = Ok(())
33832024-11-25T19:31:42.150ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33842024-11-25T19:31:42.151ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33852024-11-25T19:31:42.152ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33862024-11-25T19:31:42.152ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33872024-11-25T19:31:42.154ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33882024-11-25T19:31:42.154ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33892024-11-25T19:31:42.155ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33902024-11-25T19:31:42.155ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33912024-11-25T19:31:42.157ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33922024-11-25T19:31:42.158ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
33932024-11-25T19:31:42.158ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33942024-11-25T19:31:42.158ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33952024-11-25T19:31:42.159ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33962024-11-25T19:31:42.160ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("6a425ceaacd773f3fd92132419b8e46d5281c01b") } result = Ok(())
33972024-11-25T19:31:42.160ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33982024-11-25T19:31:42.160ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33992024-11-25T19:31:42.164ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34002024-11-25T19:31:42.164ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34012024-11-25T19:31:42.166ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34022024-11-25T19:31:42.166ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34032024-11-25T19:31:42.167ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34042024-11-25T19:31:42.167ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34052024-11-25T19:31:42.169ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34062024-11-25T19:31:42.169ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34072024-11-25T19:31:42.170ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34082024-11-25T19:31:42.171ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
34092024-11-25T19:31:42.171ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34102024-11-25T19:31:42.171ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34112024-11-25T19:31:42.173ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34122024-11-25T19:31:42.173ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34132024-11-25T19:31:42.174ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34142024-11-25T19:31:42.174ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34152024-11-25T19:31:42.176ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34162024-11-25T19:31:42.177ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(())
34172024-11-25T19:31:42.177ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34182024-11-25T19:31:42.177ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34192024-11-25T19:31:42.184ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34202024-11-25T19:31:42.185ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34212024-11-25T19:31:42.186ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34222024-11-25T19:31:42.187ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34232024-11-25T19:31:42.189ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /device/confirm
34242024-11-25T19:31:42.190ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = DeviceAuthRequest { parent: Fleet, key: "JVKJ-LDJW", lookup_type: ByCompositeId("user_code = \\"JVKJ-LDJW\\"") } result = Ok(()) uri = /device/confirm
34252024-11-25T19:31:42.190ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34262024-11-25T19:31:42.190ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34272024-11-25T19:31:42.191ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34282024-11-25T19:31:42.191ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34292024-11-25T19:31:42.193ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34302024-11-25T19:31:42.193ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34312024-11-25T19:31:42.195ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34322024-11-25T19:31:42.195ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34332024-11-25T19:31:42.199ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34342024-11-25T19:31:42.200ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34352024-11-25T19:31:42.202ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /device/confirm
34362024-11-25T19:31:42.203ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(()) uri = /device/confirm
34372024-11-25T19:31:42.203ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34382024-11-25T19:31:42.203ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34392024-11-25T19:31:42.205ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34402024-11-25T19:31:42.205ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34412024-11-25T19:31:42.207ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /device/confirm
34422024-11-25T19:31:42.208ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = DeviceAuthRequest { parent: Fleet, key: "JVKJ-LDJW", lookup_type: ByCompositeId("user_code = \\"JVKJ-LDJW\\"") } result = Ok(()) uri = /device/confirm
34432024-11-25T19:31:42.208ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34442024-11-25T19:31:42.208ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34452024-11-25T19:31:42.210ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34462024-11-25T19:31:42.211ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34472024-11-25T19:31:42.212ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34482024-11-25T19:31:42.213ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34492024-11-25T19:31:42.215ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /device/confirm
34502024-11-25T19:31:42.216ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(()) uri = /device/confirm
34512024-11-25T19:31:42.216ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 roles = RoleSet { roles: {} } uri = /device/confirm
34522024-11-25T19:31:42.216ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 resource = Database result = Ok(()) uri = /device/confirm
34532024-11-25T19:31:42.223ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78359 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = 9593d7c7-40ec-451a-a527-e5b77eb46399 response_code = 204 uri = /device/confirm
34542024-11-25T19:31:42.228ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34552024-11-25T19:31:42.228ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34562024-11-25T19:31:42.236ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11952 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.1.100:56605 req_id = cb88db41-ac2d-4984-ad7f-2799552bc07a response_code = 200 uri = /device/token
34572024-11-25T19:31:42.238ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34582024-11-25T19:31:42.238ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34592024-11-25T19:31:42.239ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34602024-11-25T19:31:42.239ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34612024-11-25T19:31:42.240ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34622024-11-25T19:31:42.241ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("token = \\"6a425ceaacd773f3fd92132419b8e46d5281c01b\\"") } result = Ok(())
34632024-11-25T19:31:42.241ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34642024-11-25T19:31:42.241ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34652024-11-25T19:31:42.243ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34662024-11-25T19:31:42.243ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34672024-11-25T19:31:42.244ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34682024-11-25T19:31:42.244ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34692024-11-25T19:31:42.245ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34702024-11-25T19:31:42.246ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34712024-11-25T19:31:42.247ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34722024-11-25T19:31:42.248ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
34732024-11-25T19:31:42.248ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34742024-11-25T19:31:42.248ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34752024-11-25T19:31:42.249ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34762024-11-25T19:31:42.250ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("6a425ceaacd773f3fd92132419b8e46d5281c01b") } result = Ok(())
34772024-11-25T19:31:42.250ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34782024-11-25T19:31:42.250ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34792024-11-25T19:31:42.255ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34802024-11-25T19:31:42.255ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34812024-11-25T19:31:42.257ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34822024-11-25T19:31:42.257ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34832024-11-25T19:31:42.258ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34842024-11-25T19:31:42.258ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34852024-11-25T19:31:42.262ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34862024-11-25T19:31:42.262ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34872024-11-25T19:31:42.263ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34882024-11-25T19:31:42.265ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
34892024-11-25T19:31:42.265ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34902024-11-25T19:31:42.265ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34912024-11-25T19:31:42.266ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34922024-11-25T19:31:42.267ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34932024-11-25T19:31:42.268ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34942024-11-25T19:31:42.268ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34952024-11-25T19:31:42.270ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34962024-11-25T19:31:42.271ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(())
34972024-11-25T19:31:42.271ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
34982024-11-25T19:31:42.271ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
34992024-11-25T19:31:42.273ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35002024-11-25T19:31:42.273ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35012024-11-25T19:31:42.275ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35022024-11-25T19:31:42.275ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35032024-11-25T19:31:42.277ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35042024-11-25T19:31:42.278ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35052024-11-25T19:31:42.279ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35062024-11-25T19:31:42.279ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35072024-11-25T19:31:42.281ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35082024-11-25T19:31:42.282ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35092024-11-25T19:31:42.284ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35102024-11-25T19:31:42.284ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35112024-11-25T19:31:42.286ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35122024-11-25T19:31:42.286ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35132024-11-25T19:31:42.289ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35142024-11-25T19:31:42.292ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") }, key: 0a8674db-071b-4f31-a475-0657ec4a0e5f, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35152024-11-25T19:31:42.292ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35162024-11-25T19:31:42.292ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35172024-11-25T19:31:42.294ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35182024-11-25T19:31:42.295ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35192024-11-25T19:31:42.297ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35202024-11-25T19:31:42.297ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35212024-11-25T19:31:42.299ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35222024-11-25T19:31:42.300ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35232024-11-25T19:31:42.301ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35242024-11-25T19:31:42.304ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") }, key: 0a8674db-071b-4f31-a475-0657ec4a0e5f, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35252024-11-25T19:31:42.304ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35262024-11-25T19:31:42.304ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35272024-11-25T19:31:42.306ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35282024-11-25T19:31:42.306ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35292024-11-25T19:31:42.310ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35302024-11-25T19:31:42.310ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35312024-11-25T19:31:42.327ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35322024-11-25T19:31:42.327ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35332024-11-25T19:31:42.332ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94941 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = cb4a01d6-8207-4ce3-b5e7-dd33fb2a265e response_code = 204 uri = /v1/vpc-subnets/default?project=proj-8d57965ed9f&vpc=default
35342024-11-25T19:31:42.332ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Signaled
35352024-11-25T19:31:42.332ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35362024-11-25T19:31:42.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35372024-11-25T19:31:42.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35382024-11-25T19:31:42.334ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35392024-11-25T19:31:42.334ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35402024-11-25T19:31:42.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35412024-11-25T19:31:42.335ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35422024-11-25T19:31:42.335ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35432024-11-25T19:31:42.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35442024-11-25T19:31:42.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35452024-11-25T19:31:42.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35462024-11-25T19:31:42.337ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35472024-11-25T19:31:42.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35482024-11-25T19:31:42.338ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("token = \\"6a425ceaacd773f3fd92132419b8e46d5281c01b\\"") } result = Ok(())
35492024-11-25T19:31:42.338ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35502024-11-25T19:31:42.339ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35512024-11-25T19:31:42.339ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35522024-11-25T19:31:42.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35532024-11-25T19:31:42.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35542024-11-25T19:31:42.340ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35552024-11-25T19:31:42.340ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35562024-11-25T19:31:42.342ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35572024-11-25T19:31:42.342ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35582024-11-25T19:31:42.343ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35592024-11-25T19:31:42.343ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35602024-11-25T19:31:42.344ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35612024-11-25T19:31:42.346ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
35622024-11-25T19:31:42.346ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35632024-11-25T19:31:42.346ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35642024-11-25T19:31:42.347ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35652024-11-25T19:31:42.348ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("6a425ceaacd773f3fd92132419b8e46d5281c01b") } result = Ok(())
35662024-11-25T19:31:42.348ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35672024-11-25T19:31:42.348ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35682024-11-25T19:31:42.371ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35692024-11-25T19:31:42.371ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35702024-11-25T19:31:42.373ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c623130-ac0d-4c81-a4da-b91fc2b51bf0", "content-length": "312", "date": "Mon, 25 Nov 2024 19:31:42 GMT"} })
35712024-11-25T19:31:42.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35722024-11-25T19:31:42.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35732024-11-25T19:31:42.376ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35742024-11-25T19:31:42.376ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35752024-11-25T19:31:42.377ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35762024-11-25T19:31:42.377ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35772024-11-25T19:31:42.379ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35782024-11-25T19:31:42.379ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35792024-11-25T19:31:42.380ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35802024-11-25T19:31:42.380ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35812024-11-25T19:31:42.381ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35822024-11-25T19:31:42.383ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
35832024-11-25T19:31:42.383ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35842024-11-25T19:31:42.383ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35852024-11-25T19:31:42.384ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35862024-11-25T19:31:42.385ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35872024-11-25T19:31:42.386ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35882024-11-25T19:31:42.386ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35892024-11-25T19:31:42.388ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35902024-11-25T19:31:42.389ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(())
35912024-11-25T19:31:42.389ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
35922024-11-25T19:31:42.389ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
35932024-11-25T19:31:42.390ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
35942024-11-25T19:31:42.390ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
35952024-11-25T19:31:42.392ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
35962024-11-25T19:31:42.392ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
35972024-11-25T19:31:42.394ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
35982024-11-25T19:31:42.394ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
35992024-11-25T19:31:42.397ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36002024-11-25T19:31:42.397ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36012024-11-25T19:31:42.399ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36022024-11-25T19:31:42.399ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36032024-11-25T19:31:42.402ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36042024-11-25T19:31:42.402ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36052024-11-25T19:31:42.404ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36062024-11-25T19:31:42.407ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36072024-11-25T19:31:42.407ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36082024-11-25T19:31:42.407ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36092024-11-25T19:31:42.409ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36102024-11-25T19:31:42.409ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36112024-11-25T19:31:42.411ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
36122024-11-25T19:31:42.411ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36132024-11-25T19:31:42.411ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e2523d28-b4ae-4859-8eb5-eb79aaab4443", "date": "Mon, 25 Nov 2024 19:31:42 GMT"} })
36142024-11-25T19:31:42.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36152024-11-25T19:31:42.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36162024-11-25T19:31:42.412ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36172024-11-25T19:31:42.412ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36182024-11-25T19:31:42.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36192024-11-25T19:31:42.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36202024-11-25T19:31:42.414ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36212024-11-25T19:31:42.415ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36222024-11-25T19:31:42.417ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36232024-11-25T19:31:42.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36242024-11-25T19:31:42.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36252024-11-25T19:31:42.419ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36262024-11-25T19:31:42.419ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36272024-11-25T19:31:42.420ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36282024-11-25T19:31:42.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36292024-11-25T19:31:42.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36302024-11-25T19:31:42.421ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36312024-11-25T19:31:42.421ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36322024-11-25T19:31:42.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36332024-11-25T19:31:42.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36342024-11-25T19:31:42.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36352024-11-25T19:31:42.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36362024-11-25T19:31:42.424ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36372024-11-25T19:31:42.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36382024-11-25T19:31:42.426ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36392024-11-25T19:31:42.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36402024-11-25T19:31:42.427ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36412024-11-25T19:31:42.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36422024-11-25T19:31:42.427ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36432024-11-25T19:31:42.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36442024-11-25T19:31:42.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36452024-11-25T19:31:42.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36462024-11-25T19:31:42.429ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36472024-11-25T19:31:42.429ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36482024-11-25T19:31:42.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36492024-11-25T19:31:42.431ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36502024-11-25T19:31:42.432ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36512024-11-25T19:31:42.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
36522024-11-25T19:31:42.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36532024-11-25T19:31:42.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36542024-11-25T19:31:42.434ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36552024-11-25T19:31:42.434ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36562024-11-25T19:31:42.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36572024-11-25T19:31:42.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36582024-11-25T19:31:42.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36592024-11-25T19:31:42.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36602024-11-25T19:31:42.436ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36612024-11-25T19:31:42.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36622024-11-25T19:31:42.440ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") }, key: beab2cae-104c-4e0c-b8c2-23c5b6c72393, lookup_type: ById(beab2cae-104c-4e0c-b8c2-23c5b6c72393) } result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36632024-11-25T19:31:42.440ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36642024-11-25T19:31:42.440ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36652024-11-25T19:31:42.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
36662024-11-25T19:31:42.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36672024-11-25T19:31:42.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36682024-11-25T19:31:42.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36692024-11-25T19:31:42.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36702024-11-25T19:31:42.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36712024-11-25T19:31:42.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36722024-11-25T19:31:42.445ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36732024-11-25T19:31:42.445ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36742024-11-25T19:31:42.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36752024-11-25T19:31:42.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36762024-11-25T19:31:42.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36772024-11-25T19:31:42.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36782024-11-25T19:31:42.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36792024-11-25T19:31:42.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36802024-11-25T19:31:42.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36812024-11-25T19:31:42.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36822024-11-25T19:31:42.452ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36832024-11-25T19:31:42.452ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36842024-11-25T19:31:42.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36852024-11-25T19:31:42.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36862024-11-25T19:31:42.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36872024-11-25T19:31:42.454ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36882024-11-25T19:31:42.454ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36892024-11-25T19:31:42.456ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36902024-11-25T19:31:42.456ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36912024-11-25T19:31:42.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
36922024-11-25T19:31:42.457ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36932024-11-25T19:31:42.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36942024-11-25T19:31:42.458ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
36952024-11-25T19:31:42.459ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
36962024-11-25T19:31:42.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36972024-11-25T19:31:42.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36982024-11-25T19:31:42.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36992024-11-25T19:31:42.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37002024-11-25T19:31:42.461ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
37012024-11-25T19:31:42.461ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
37022024-11-25T19:31:42.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37032024-11-25T19:31:42.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37042024-11-25T19:31:42.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37052024-11-25T19:31:42.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37062024-11-25T19:31:42.463ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
37072024-11-25T19:31:42.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37082024-11-25T19:31:42.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37092024-11-25T19:31:42.465ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37102024-11-25T19:31:42.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37112024-11-25T19:31:42.466ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") }, key: f00628a7-3e59-4fd5-9a30-a15b6f931c75, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
37122024-11-25T19:31:42.466ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-8d57965ed9f
37132024-11-25T19:31:42.466ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-8d57965ed9f
37142024-11-25T19:31:42.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37152024-11-25T19:31:42.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
37162024-11-25T19:31:42.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37172024-11-25T19:31:42.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37182024-11-25T19:31:42.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37192024-11-25T19:31:42.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37202024-11-25T19:31:42.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37212024-11-25T19:31:42.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37222024-11-25T19:31:42.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37232024-11-25T19:31:42.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37242024-11-25T19:31:42.475ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141243 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = 944d36b8-1d9a-4739-8237-4b3ec22032be response_code = 204 uri = /v1/vpcs/default?project=proj-8d57965ed9f
37252024-11-25T19:31:42.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37262024-11-25T19:31:42.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37272024-11-25T19:31:42.476ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37282024-11-25T19:31:42.476ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37292024-11-25T19:31:42.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37302024-11-25T19:31:42.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37312024-11-25T19:31:42.477ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37322024-11-25T19:31:42.478ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37332024-11-25T19:31:42.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37342024-11-25T19:31:42.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37352024-11-25T19:31:42.479ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37362024-11-25T19:31:42.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37372024-11-25T19:31:42.480ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("token = \\"6a425ceaacd773f3fd92132419b8e46d5281c01b\\"") } result = Ok(())
37382024-11-25T19:31:42.480ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37392024-11-25T19:31:42.480ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37402024-11-25T19:31:42.482ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37412024-11-25T19:31:42.482ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37422024-11-25T19:31:42.483ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37432024-11-25T19:31:42.483ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37442024-11-25T19:31:42.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
37452024-11-25T19:31:42.483ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37462024-11-25T19:31:42.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37472024-11-25T19:31:42.484ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37482024-11-25T19:31:42.484ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37492024-11-25T19:31:42.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37502024-11-25T19:31:42.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37512024-11-25T19:31:42.485ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37522024-11-25T19:31:42.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37532024-11-25T19:31:42.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37542024-11-25T19:31:42.486ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
37552024-11-25T19:31:42.486ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37562024-11-25T19:31:42.486ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37572024-11-25T19:31:42.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37582024-11-25T19:31:42.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37592024-11-25T19:31:42.488ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37602024-11-25T19:31:42.489ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6a425ceaacd773f3fd92132419b8e46d5281c01b", lookup_type: ByCompositeId("6a425ceaacd773f3fd92132419b8e46d5281c01b") } result = Ok(())
37612024-11-25T19:31:42.489ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37622024-11-25T19:31:42.489ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37632024-11-25T19:31:42.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37642024-11-25T19:31:42.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37652024-11-25T19:31:42.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37662024-11-25T19:31:42.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37672024-11-25T19:31:42.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37682024-11-25T19:31:42.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37692024-11-25T19:31:42.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37702024-11-25T19:31:42.493ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37712024-11-25T19:31:42.494ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37722024-11-25T19:31:42.495ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37732024-11-25T19:31:42.495ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37742024-11-25T19:31:42.496ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37752024-11-25T19:31:42.496ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37762024-11-25T19:31:42.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000002, lookup_type: ByName("default") } result = Ok(())
37772024-11-25T19:31:42.496ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37782024-11-25T19:31:42.497ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37792024-11-25T19:31:42.498ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37802024-11-25T19:31:42.499ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37812024-11-25T19:31:42.500ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7014bfea-9f6e-4c0e-ad9c-2e40ddd41f3b", "date": "Mon, 25 Nov 2024 19:31:42 GMT"} })
37822024-11-25T19:31:42.500ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b07c52d4-1b1f-4e65-80c8-8988517a418b, lookup_type: ById(b07c52d4-1b1f-4e65-80c8-8988517a418b) } result = Ok(())
37832024-11-25T19:31:42.500ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37842024-11-25T19:31:42.500ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37852024-11-25T19:31:42.501ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 168.344033ms iteration = 2 status = {}
37862024-11-25T19:31:42.501ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37872024-11-25T19:31:42.501ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37882024-11-25T19:31:42.503ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37892024-11-25T19:31:42.503ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37902024-11-25T19:31:42.504ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37912024-11-25T19:31:42.505ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) } result = Ok(())
37922024-11-25T19:31:42.505ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
37932024-11-25T19:31:42.505ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
37942024-11-25T19:31:42.506ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
37952024-11-25T19:31:42.506ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
37962024-11-25T19:31:42.507ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
37972024-11-25T19:31:42.507ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
37982024-11-25T19:31:42.509ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
37992024-11-25T19:31:42.510ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38002024-11-25T19:31:42.512ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38012024-11-25T19:31:42.512ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38022024-11-25T19:31:42.513ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38032024-11-25T19:31:42.513ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38042024-11-25T19:31:42.516ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/projects/proj-8d57965ed9f
38052024-11-25T19:31:42.518ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") } result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38062024-11-25T19:31:42.518ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38072024-11-25T19:31:42.518ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38082024-11-25T19:31:42.520ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38092024-11-25T19:31:42.520ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38102024-11-25T19:31:42.522ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38112024-11-25T19:31:42.522ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38122024-11-25T19:31:42.524ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38132024-11-25T19:31:42.524ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38142024-11-25T19:31:42.525ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {(Silo, d67475c9-87ae-4d90-9f64-ff01c1ac932d, "admin")} } uri = /v1/projects/proj-8d57965ed9f
38152024-11-25T19:31:42.527ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: 1a21b215-9387-4301-933d-ff3b2e222168, lookup_type: ByName("proj-8d57965ed9f") } result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38162024-11-25T19:31:42.527ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38172024-11-25T19:31:42.527ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38182024-11-25T19:31:42.529ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38192024-11-25T19:31:42.530ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38202024-11-25T19:31:42.531ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38212024-11-25T19:31:42.531ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38222024-11-25T19:31:42.548ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38232024-11-25T19:31:42.548ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38242024-11-25T19:31:42.567ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38252024-11-25T19:31:42.567ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38262024-11-25T19:31:42.577ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38272024-11-25T19:31:42.577ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38282024-11-25T19:31:42.579ZDEBGnexus (dropshot_external): roles actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d roles = RoleSet { roles: {} } uri = /v1/projects/proj-8d57965ed9f
38292024-11-25T19:31:42.579ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b07c52d4-1b1f-4e65-80c8-8988517a418b, silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, .. }) actor_id = b07c52d4-1b1f-4e65-80c8-8988517a418b authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d resource = Database result = Ok(()) uri = /v1/projects/proj-8d57965ed9f
38302024-11-25T19:31:42.587ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111174 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.1.100:56605 req_id = b1be4b35-1698-4a12-b7b9-574faf33486d response_code = 204 uri = /v1/projects/proj-8d57965ed9f
38312024-11-25T19:31:43.046ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:32974
38322024-11-25T19:31:43.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:32974 req_id = 03688eb5-7f65-4e15-9dbf-e9b53fa65815 roles = RoleSet { roles: {} } uri = /metrics/producers
38332024-11-25T19:31:43.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:32974 req_id = 03688eb5-7f65-4e15-9dbf-e9b53fa65815 resource = Database result = Ok(()) uri = /metrics/producers
38342024-11-25T19:31:43.060ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b59496f2-fc6d-46cb-9cf5-9b1a2e24358f
38352024-11-25T19:31:43.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10638 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:32974 req_id = 03688eb5-7f65-4e15-9dbf-e9b53fa65815 response_code = 201 uri = /metrics/producers
38362024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
38372024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
38382024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38392024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38402024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
38412024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38422024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
38432024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
38442024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38452024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38462024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
38472024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
38482024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38492024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38502024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
38512024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38522024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
38532024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38542024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
38552024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38562024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
38572024-11-25T19:31:46.201ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38582024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38592024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
38602024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38612024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38622024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
38632024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38642024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
38652024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
38662024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
38672024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38682024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
38692024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38702024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38712024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38722024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38732024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38742024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38752024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38762024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38772024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38782024-11-25T19:31:46.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38792024-11-25T19:31:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38802024-11-25T19:31:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38812024-11-25T19:31:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38822024-11-25T19:31:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38832024-11-25T19:31:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38842024-11-25T19:31:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38852024-11-25T19:31:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38862024-11-25T19:31:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38872024-11-25T19:31:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38882024-11-25T19:31:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38892024-11-25T19:31:46.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38902024-11-25T19:31:46.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38912024-11-25T19:31:46.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38922024-11-25T19:31:46.206ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1131, tv_nsec: 755134922 } })
38932024-11-25T19:31:46.207ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
38942024-11-25T19:31:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38952024-11-25T19:31:46.207ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38962024-11-25T19:31:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38972024-11-25T19:31:46.207ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38982024-11-25T19:31:46.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38992024-11-25T19:31:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39002024-11-25T19:31:46.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39012024-11-25T19:31:46.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39022024-11-25T19:31:46.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39032024-11-25T19:31:46.209ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39042024-11-25T19:31:46.209ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39052024-11-25T19:31:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39062024-11-25T19:31:46.212ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39072024-11-25T19:31:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39082024-11-25T19:31:46.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39092024-11-25T19:31:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39102024-11-25T19:31:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39112024-11-25T19:31:46.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39122024-11-25T19:31:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39132024-11-25T19:31:46.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39142024-11-25T19:31:46.214ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 13.461115ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39152024-11-25T19:31:46.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39162024-11-25T19:31:46.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39172024-11-25T19:31:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39182024-11-25T19:31:46.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39192024-11-25T19:31:46.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39202024-11-25T19:31:46.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39212024-11-25T19:31:46.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39222024-11-25T19:31:46.222ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1131, tv_nsec: 771079354 } })
39232024-11-25T19:31:46.223ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1131, tv_nsec: 771276208 } })
39242024-11-25T19:31:46.223ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
39252024-11-25T19:31:46.223ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
39262024-11-25T19:31:46.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39272024-11-25T19:31:46.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39282024-11-25T19:31:46.225ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39292024-11-25T19:31:46.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39302024-11-25T19:31:46.227ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39312024-11-25T19:31:46.227ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.573782ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39322024-11-25T19:31:46.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39332024-11-25T19:31:46.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39342024-11-25T19:31:46.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39352024-11-25T19:31:46.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39362024-11-25T19:31:46.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39372024-11-25T19:31:46.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39382024-11-25T19:31:46.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39392024-11-25T19:31:46.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
39402024-11-25T19:31:46.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39412024-11-25T19:31:46.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39422024-11-25T19:31:46.248ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
39432024-11-25T19:31:46.248ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.219666ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
39442024-11-25T19:31:46.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.451041ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
39452024-11-25T19:31:46.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39462024-11-25T19:31:46.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39472024-11-25T19:31:46.252ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39482024-11-25T19:31:46.252ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39492024-11-25T19:31:46.252ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39502024-11-25T19:31:46.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39512024-11-25T19:31:46.254ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.121402ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
39522024-11-25T19:31:46.254ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39532024-11-25T19:31:46.254ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39542024-11-25T19:31:46.254ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39552024-11-25T19:31:46.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39562024-11-25T19:31:46.255ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39572024-11-25T19:31:46.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39582024-11-25T19:31:46.256ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 54.884417ms iteration = 4 status = {"physical_disks_added":0}
39592024-11-25T19:31:46.258ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.164172ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39602024-11-25T19:31:46.258ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39612024-11-25T19:31:46.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39622024-11-25T19:31:46.260ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.190362ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39632024-11-25T19:31:46.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39642024-11-25T19:31:46.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39652024-11-25T19:31:46.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.967484ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
39662024-11-25T19:31:46.306ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39672024-11-25T19:31:46.306ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39682024-11-25T19:31:46.306ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.199335ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39692024-11-25T19:31:46.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.674256ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
39702024-11-25T19:31:46.328ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
39712024-11-25T19:31:46.328ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39722024-11-25T19:31:46.329ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1530a4be-3969-4ceb-ac84-87a2eb065e18", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
39732024-11-25T19:31:46.329ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39742024-11-25T19:31:46.330ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39752024-11-25T19:31:46.341ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39762024-11-25T19:31:46.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39772024-11-25T19:31:46.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39782024-11-25T19:31:46.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39792024-11-25T19:31:46.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39802024-11-25T19:31:46.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39812024-11-25T19:31:46.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39822024-11-25T19:31:46.348ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39832024-11-25T19:31:46.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39842024-11-25T19:31:46.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39852024-11-25T19:31:46.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39862024-11-25T19:31:46.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39872024-11-25T19:31:46.371ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39882024-11-25T19:31:46.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39892024-11-25T19:31:46.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39902024-11-25T19:31:46.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
39912024-11-25T19:31:46.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39922024-11-25T19:31:46.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39932024-11-25T19:31:46.382ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
39942024-11-25T19:31:46.382ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39952024-11-25T19:31:46.383ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9dffe59-9e04-4b0f-8075-cc2240d11171", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
39962024-11-25T19:31:46.383ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39972024-11-25T19:31:46.384ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39982024-11-25T19:31:46.423ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
39992024-11-25T19:31:46.423ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40002024-11-25T19:31:46.423ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcb82954-3583-41d3-bc75-7e3320f43877", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
40012024-11-25T19:31:46.423ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40022024-11-25T19:31:46.425ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
40032024-11-25T19:31:46.425ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40042024-11-25T19:31:46.425ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40052024-11-25T19:31:46.426ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e20ee6fe-cd5f-4d39-98c9-60cdf81d93e2", "content-length": "372", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
40062024-11-25T19:31:46.426ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40072024-11-25T19:31:46.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40082024-11-25T19:31:46.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40092024-11-25T19:31:46.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40102024-11-25T19:31:46.438ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40112024-11-25T19:31:46.438ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dc78ce6-fe95-47e8-909f-944790a3c72a", "content-length": "1", "date": "Mon, 25 Nov 2024 19:31:45 GMT"} })
40122024-11-25T19:31:46.440ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40132024-11-25T19:31:46.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40142024-11-25T19:31:46.455ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40152024-11-25T19:31:46.457ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "38655f55-8228-4af3-8dd2-065a0b09a20b", "content-length": "691", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
40162024-11-25T19:31:46.457ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
40172024-11-25T19:31:46.457ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
40182024-11-25T19:31:46.457ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
40192024-11-25T19:31:46.458ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 256.943211ms iteration = 2 status = {}
40202024-11-25T19:31:46.464ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 262.889968ms iteration = 2 status = null
40212024-11-25T19:31:46.475ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40222024-11-25T19:31:46.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40232024-11-25T19:31:46.478ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 277.409863ms iteration = 2 status = {}
40242024-11-25T19:31:46.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40252024-11-25T19:31:46.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40262024-11-25T19:31:46.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40272024-11-25T19:31:46.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40282024-11-25T19:31:46.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40292024-11-25T19:31:46.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40302024-11-25T19:31:46.509ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
40312024-11-25T19:31:46.509ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40322024-11-25T19:31:46.509ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "97c0ad29-754c-41bd-9f8d-464dc29f7f22", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
40332024-11-25T19:31:46.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40342024-11-25T19:31:46.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40352024-11-25T19:31:46.510ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40362024-11-25T19:31:46.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40372024-11-25T19:31:46.512ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40382024-11-25T19:31:46.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40392024-11-25T19:31:46.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40402024-11-25T19:31:46.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40412024-11-25T19:31:46.516ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1132, tv_nsec: 64203066 } })
40422024-11-25T19:31:46.516ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1103
40432024-11-25T19:31:46.518ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40442024-11-25T19:31:46.518ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40452024-11-25T19:31:46.519ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a5dc3f86-86e5-423a-9f6a-f04242b84b6d", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
40462024-11-25T19:31:46.520ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 319.538569ms iteration = 3 status = {}
40472024-11-25T19:31:46.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40482024-11-25T19:31:46.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40492024-11-25T19:31:46.554ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40502024-11-25T19:31:46.554ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40512024-11-25T19:31:46.554ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0adc8c40-28dd-4510-8572-1437c2bbd5da", "content-length": "26", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
40522024-11-25T19:31:46.554ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40532024-11-25T19:31:46.555ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40542024-11-25T19:31:46.555ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
40552024-11-25T19:31:46.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40562024-11-25T19:31:46.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40572024-11-25T19:31:46.583ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
40582024-11-25T19:31:46.584ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "95764044-60a3-41a8-af1f-73394d3de6f6", "content-length": "4", "date": "Mon, 25 Nov 2024 19:31:45 GMT"} })
40592024-11-25T19:31:46.586ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 384.924412ms iteration = 2 status = 6
40602024-11-25T19:31:46.612ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40612024-11-25T19:31:46.614ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "da983626-7fec-4732-a398-1bc85b31dcb6", "content-length": "134", "date": "Mon, 25 Nov 2024 19:31:45 GMT"} })
40622024-11-25T19:31:46.614ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
40632024-11-25T19:31:46.614ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
40642024-11-25T19:31:46.616ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40652024-11-25T19:31:46.616ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40662024-11-25T19:31:46.616ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40672024-11-25T19:31:46.616ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40682024-11-25T19:31:46.616ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40692024-11-25T19:31:46.616ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40702024-11-25T19:31:46.621ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40712024-11-25T19:31:46.621ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40722024-11-25T19:31:46.621ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
40732024-11-25T19:31:46.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40742024-11-25T19:31:46.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40752024-11-25T19:31:46.624ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40762024-11-25T19:31:46.625ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8ed6b2d-e48c-43de-bd41-c3d76c1a4153", "content-length": "2", "date": "Mon, 25 Nov 2024 19:31:45 GMT"} })
40772024-11-25T19:31:46.625ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40782024-11-25T19:31:46.626ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ce8542c-5d5c-4360-a3c6-5f24a2a81e82", "content-length": "51", "date": "Mon, 25 Nov 2024 19:31:45 GMT"} })
40792024-11-25T19:31:46.626ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
40802024-11-25T19:31:46.626ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40812024-11-25T19:31:46.772ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "566daa98-653c-4846-8ef1-8a591523e666", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
40822024-11-25T19:31:46.772ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
40832024-11-25T19:31:46.772ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40842024-11-25T19:31:46.772ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8143653-a50d-4ae4-8c7f-1e8ed0e23a5a", "content-length": "539", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
40852024-11-25T19:31:46.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40862024-11-25T19:31:46.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40872024-11-25T19:31:46.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40882024-11-25T19:31:46.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40892024-11-25T19:31:46.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40902024-11-25T19:31:46.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40912024-11-25T19:31:46.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40922024-11-25T19:31:46.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40932024-11-25T19:31:46.797ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1229 key = network_key rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
40942024-11-25T19:31:46.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40952024-11-25T19:31:46.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40962024-11-25T19:31:46.802ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None }], switch: Switch0, tx_eq: None, uplink_port_fec: Some(None), uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 2, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1286 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
40972024-11-25T19:31:46.802ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40982024-11-25T19:31:46.806ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 204, headers: {"x-request-id": "74bed0f7-0732-4619-8fc8-39604dda33c7", "date": "Mon, 25 Nov 2024 19:31:46 GMT"} })
40992024-11-25T19:31:46.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41002024-11-25T19:31:46.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41012024-11-25T19:31:46.820ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 619.660449ms iteration = 2 status = {}
41022024-11-25T19:31:47.288ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1387 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 3e845c26-be32-4818-81d6-ca3a7ab58780 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
41032024-11-25T19:31:52.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37852 req_id = b908d486-4bb2-42f5-ad5a-27e7421b916b roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
41042024-11-25T19:31:52.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37852 req_id = b908d486-4bb2-42f5-ad5a-27e7421b916b resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
41052024-11-25T19:31:52.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37852 req_id = b908d486-4bb2-42f5-ad5a-27e7421b916b response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
41062024-11-25T19:31:52.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37852 req_id = c4eb4e5d-8b61-4f9a-8301-b5b985452b69 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiNTk0OTZmMi1mYzZkLTQ2Y2ItOWNmNS05YjFhMmUyNDM1OGYifX0%3D
41072024-11-25T19:31:52.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37852 req_id = c4eb4e5d-8b61-4f9a-8301-b5b985452b69 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiNTk0OTZmMi1mYzZkLTQ2Y2ItOWNmNS05YjFhMmUyNDM1OGYifX0%3D
41082024-11-25T19:31:52.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37852 req_id = c4eb4e5d-8b61-4f9a-8301-b5b985452b69 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiNTk0OTZmMi1mYzZkLTQ2Y2ItOWNmNS05YjFhMmUyNDM1OGYifX0%3D
41092024-11-25T19:31:56.201ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
41102024-11-25T19:31:56.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41112024-11-25T19:31:56.201ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
41122024-11-25T19:31:56.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41132024-11-25T19:31:56.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41142024-11-25T19:31:56.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41152024-11-25T19:31:56.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41162024-11-25T19:31:56.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41172024-11-25T19:31:56.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41182024-11-25T19:31:56.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41192024-11-25T19:31:56.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41202024-11-25T19:31:56.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41212024-11-25T19:31:56.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41222024-11-25T19:31:56.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41232024-11-25T19:31:56.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41242024-11-25T19:31:56.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
41252024-11-25T19:31:56.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41262024-11-25T19:31:56.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41272024-11-25T19:31:56.224ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
41282024-11-25T19:31:56.224ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.055422ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
41292024-11-25T19:31:56.231ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.806264ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41302024-11-25T19:31:57.289ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1196 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 16ddc81b-1faf-4aec-806c-f3a515c9a946 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
41312024-11-25T19:32:06.197ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:58683
41322024-11-25T19:32:06.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58683 req_id = 857bef54-187d-4e70-8d9d-7302c0465505 roles = RoleSet { roles: {} } uri = /metrics/producers
41332024-11-25T19:32:06.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58683 req_id = 857bef54-187d-4e70-8d9d-7302c0465505 resource = Database result = Ok(()) uri = /metrics/producers
41342024-11-25T19:32:06.201ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
41352024-11-25T19:32:06.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41362024-11-25T19:32:06.201ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
41372024-11-25T19:32:06.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41382024-11-25T19:32:06.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41392024-11-25T19:32:06.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41402024-11-25T19:32:06.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41412024-11-25T19:32:06.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41422024-11-25T19:32:06.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41432024-11-25T19:32:06.205ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = e1e4675c-73a5-46b5-9e0f-9d05cbba5670
41442024-11-25T19:32:06.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7785 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58683 req_id = 857bef54-187d-4e70-8d9d-7302c0465505 response_code = 201 uri = /metrics/producers
41452024-11-25T19:32:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41462024-11-25T19:32:06.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41472024-11-25T19:32:06.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41482024-11-25T19:32:06.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41492024-11-25T19:32:06.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41502024-11-25T19:32:06.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41512024-11-25T19:32:06.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
41522024-11-25T19:32:06.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41532024-11-25T19:32:06.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41542024-11-25T19:32:06.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.398816ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41552024-11-25T19:32:06.267ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
41562024-11-25T19:32:06.267ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.72448ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
41572024-11-25T19:32:07.316ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1412 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 6c40f1e5-f627-49f4-b4af-c9d6ede05e74 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
41582024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
41592024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
41602024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41612024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
41622024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41632024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41642024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
41652024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
41662024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41672024-11-25T19:32:16.201ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:22:16.201074938 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
41682024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
41692024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
41702024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
41712024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41722024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
41732024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
41742024-11-25T19:32:16.201ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
41752024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.23\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
41762024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
41772024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
41782024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
41792024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
41802024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41812024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
41822024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41832024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
41842024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
41852024-11-25T19:32:16.201ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41862024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41872024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
41882024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41892024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41902024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
41912024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
41922024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41932024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41942024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
41952024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
41962024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
41972024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41982024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41992024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
42002024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42012024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
42022024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
42032024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42042024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42052024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
42062024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
42072024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42082024-11-25T19:32:16.201ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42092024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42102024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
42112024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42122024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
42132024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
42142024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42152024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42162024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42172024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
42182024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
42192024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42202024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
42212024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42222024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42232024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
42242024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42252024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
42262024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42272024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
42282024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42292024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42302024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42312024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42322024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42332024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42342024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
42352024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42362024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42372024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42382024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42392024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42402024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42412024-11-25T19:32:16.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42422024-11-25T19:32:16.201ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1161, tv_nsec: 749546912 } })
42432024-11-25T19:32:16.202ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1161, tv_nsec: 749574663 } })
42442024-11-25T19:32:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42452024-11-25T19:32:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42462024-11-25T19:32:16.202ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
42472024-11-25T19:32:16.202ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.246795ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
42482024-11-25T19:32:16.202ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
42492024-11-25T19:32:16.202ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.253254ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
42502024-11-25T19:32:16.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42512024-11-25T19:32:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42522024-11-25T19:32:16.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42532024-11-25T19:32:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42542024-11-25T19:32:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42552024-11-25T19:32:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.842515ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
42562024-11-25T19:32:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.772064ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
42572024-11-25T19:32:16.206ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:22:16.201074938 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
42582024-11-25T19:32:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.505128ms iteration = 2 status = {"expiration":"2024-11-25T19:22:16.201074938Z","pruned":[]}
42592024-11-25T19:32:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
42602024-11-25T19:32:16.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42612024-11-25T19:32:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42622024-11-25T19:32:16.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42632024-11-25T19:32:16.209ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.11907ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
42642024-11-25T19:32:16.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42652024-11-25T19:32:16.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1161, tv_nsec: 757912676 } })
42662024-11-25T19:32:16.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
42672024-11-25T19:32:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42682024-11-25T19:32:16.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42692024-11-25T19:32:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42702024-11-25T19:32:16.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42712024-11-25T19:32:16.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42722024-11-25T19:32:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42732024-11-25T19:32:16.212ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42742024-11-25T19:32:16.212ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42752024-11-25T19:32:16.212ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42762024-11-25T19:32:16.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42772024-11-25T19:32:16.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42782024-11-25T19:32:16.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42792024-11-25T19:32:16.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42802024-11-25T19:32:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
42812024-11-25T19:32:16.215ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42822024-11-25T19:32:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42832024-11-25T19:32:16.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42842024-11-25T19:32:16.217ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42852024-11-25T19:32:16.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42862024-11-25T19:32:16.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42872024-11-25T19:32:16.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42882024-11-25T19:32:16.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42892024-11-25T19:32:16.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42902024-11-25T19:32:16.219ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1161, tv_nsec: 766783390 } })
42912024-11-25T19:32:16.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
42922024-11-25T19:32:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42932024-11-25T19:32:16.220ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42942024-11-25T19:32:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42952024-11-25T19:32:16.222ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42962024-11-25T19:32:16.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42972024-11-25T19:32:16.225ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42982024-11-25T19:32:16.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42992024-11-25T19:32:16.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43002024-11-25T19:32:16.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43012024-11-25T19:32:16.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43022024-11-25T19:32:16.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43032024-11-25T19:32:16.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.243274ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43042024-11-25T19:32:16.228ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1161, tv_nsec: 776493391 } })
43052024-11-25T19:32:16.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43062024-11-25T19:32:16.229ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
43072024-11-25T19:32:16.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43082024-11-25T19:32:16.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43092024-11-25T19:32:16.232ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43102024-11-25T19:32:16.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43112024-11-25T19:32:16.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43122024-11-25T19:32:16.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43132024-11-25T19:32:16.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 34.560388ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
43142024-11-25T19:32:16.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43152024-11-25T19:32:16.236ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43162024-11-25T19:32:16.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43172024-11-25T19:32:16.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43182024-11-25T19:32:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43192024-11-25T19:32:16.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43202024-11-25T19:32:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43212024-11-25T19:32:16.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43222024-11-25T19:32:16.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43232024-11-25T19:32:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43242024-11-25T19:32:16.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43252024-11-25T19:32:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
43262024-11-25T19:32:16.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43272024-11-25T19:32:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43282024-11-25T19:32:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43292024-11-25T19:32:16.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43302024-11-25T19:32:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43312024-11-25T19:32:16.254ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43322024-11-25T19:32:16.254ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43332024-11-25T19:32:16.254ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43342024-11-25T19:32:16.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43352024-11-25T19:32:16.257ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43362024-11-25T19:32:16.257ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43372024-11-25T19:32:16.257ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43382024-11-25T19:32:16.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43392024-11-25T19:32:16.262ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
43402024-11-25T19:32:16.262ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
43412024-11-25T19:32:16.262ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.259012ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
43422024-11-25T19:32:16.266ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43432024-11-25T19:32:16.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43442024-11-25T19:32:16.267ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
43452024-11-25T19:32:16.267ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
43462024-11-25T19:32:16.267ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
43472024-11-25T19:32:16.267ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43482024-11-25T19:32:16.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43492024-11-25T19:32:16.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43502024-11-25T19:32:16.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.316161ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43512024-11-25T19:32:16.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43522024-11-25T19:32:16.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43532024-11-25T19:32:16.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43542024-11-25T19:32:16.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43552024-11-25T19:32:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43562024-11-25T19:32:16.276ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
43572024-11-25T19:32:16.276ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
43582024-11-25T19:32:16.276ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43592024-11-25T19:32:16.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43602024-11-25T19:32:16.276ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.442181ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
43612024-11-25T19:32:16.278ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43622024-11-25T19:32:16.278ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43632024-11-25T19:32:16.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43642024-11-25T19:32:16.278ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
43652024-11-25T19:32:16.279ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.821986ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
43662024-11-25T19:32:16.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43672024-11-25T19:32:16.280ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
43682024-11-25T19:32:16.280ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
43692024-11-25T19:32:16.280ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.439549ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
43702024-11-25T19:32:16.281ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43712024-11-25T19:32:16.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43722024-11-25T19:32:16.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43732024-11-25T19:32:16.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43742024-11-25T19:32:16.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
43752024-11-25T19:32:16.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43762024-11-25T19:32:16.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43772024-11-25T19:32:16.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
43782024-11-25T19:32:16.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43792024-11-25T19:32:16.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43802024-11-25T19:32:16.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 86.915016ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
43812024-11-25T19:32:16.289ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
43822024-11-25T19:32:16.289ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
43832024-11-25T19:32:16.289ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
43842024-11-25T19:32:16.289ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43852024-11-25T19:32:16.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43862024-11-25T19:32:16.290ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.302242ms iteration = 3 status = 0
43872024-11-25T19:32:16.291ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43882024-11-25T19:32:16.292ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43892024-11-25T19:32:16.292ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.982645ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43902024-11-25T19:32:16.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43912024-11-25T19:32:16.294ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43922024-11-25T19:32:16.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43932024-11-25T19:32:16.295ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
43942024-11-25T19:32:16.295ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43952024-11-25T19:32:16.295ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
43962024-11-25T19:32:16.295ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 94.042625ms iteration = 3 status = {"generation":2}
43972024-11-25T19:32:16.299ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43982024-11-25T19:32:16.299ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43992024-11-25T19:32:16.299ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 98.603774ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44002024-11-25T19:32:16.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44012024-11-25T19:32:16.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44022024-11-25T19:32:16.322ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44032024-11-25T19:32:16.322ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44042024-11-25T19:32:16.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44052024-11-25T19:32:16.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44062024-11-25T19:32:16.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44072024-11-25T19:32:16.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44082024-11-25T19:32:16.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44092024-11-25T19:32:16.325ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44102024-11-25T19:32:16.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44112024-11-25T19:32:16.327ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44122024-11-25T19:32:16.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44132024-11-25T19:32:16.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44142024-11-25T19:32:16.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44152024-11-25T19:32:16.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44162024-11-25T19:32:16.329ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
44172024-11-25T19:32:16.329ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
44182024-11-25T19:32:16.329ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
44192024-11-25T19:32:16.329ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 128.209165ms iteration = 3 status = {"generation":1}
44202024-11-25T19:32:16.352ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44212024-11-25T19:32:16.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44222024-11-25T19:32:16.362ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44232024-11-25T19:32:16.363ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 162.168762ms iteration = 5 status = {"physical_disks_added":0}
44242024-11-25T19:32:16.376ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
44252024-11-25T19:32:16.376ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 175.397932ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
44262024-11-25T19:32:16.404ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
44272024-11-25T19:32:16.404ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44282024-11-25T19:32:16.404ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "290830ed-c7c5-4de9-8ee3-927894907f2f", "content-length": "26", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
44292024-11-25T19:32:16.404ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44302024-11-25T19:32:16.405ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
44312024-11-25T19:32:16.405ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 204.36569ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
44322024-11-25T19:32:16.405ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44332024-11-25T19:32:16.450ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44342024-11-25T19:32:16.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44352024-11-25T19:32:16.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44362024-11-25T19:32:16.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44372024-11-25T19:32:16.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44382024-11-25T19:32:16.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44392024-11-25T19:32:16.455ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44402024-11-25T19:32:16.456ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44412024-11-25T19:32:16.456ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44422024-11-25T19:32:16.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44432024-11-25T19:32:16.489ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44442024-11-25T19:32:16.499ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
44452024-11-25T19:32:16.499ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44462024-11-25T19:32:16.499ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2976385-98e7-4fbe-af45-ad4486e154ff", "content-length": "26", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
44472024-11-25T19:32:16.499ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44482024-11-25T19:32:16.500ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44492024-11-25T19:32:16.565ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
44502024-11-25T19:32:16.565ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44512024-11-25T19:32:16.565ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44522024-11-25T19:32:16.565ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "14766f28-1a57-45b0-8844-eca01d6fbfe4", "content-length": "372", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
44532024-11-25T19:32:16.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44542024-11-25T19:32:16.565ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e30de792-3365-425f-b195-fb1c17b4cf8c", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44552024-11-25T19:32:16.565ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44562024-11-25T19:32:16.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44572024-11-25T19:32:16.567ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "deaa944c-3fda-42a8-9e67-b4aaca73d0da", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44582024-11-25T19:32:16.567ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44592024-11-25T19:32:16.569ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44602024-11-25T19:32:16.569ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 368.094502ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
44612024-11-25T19:32:16.584ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
44622024-11-25T19:32:16.584ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44632024-11-25T19:32:16.585ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "07d77930-da52-4b53-87aa-2541dbced677", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
44642024-11-25T19:32:16.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44652024-11-25T19:32:16.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44662024-11-25T19:32:16.614ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
44672024-11-25T19:32:16.615ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44682024-11-25T19:32:16.615ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "96f1d568-2df4-4743-a6f1-a9b1d837db3f", "content-length": "26", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
44692024-11-25T19:32:16.615ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44702024-11-25T19:32:16.616ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
44712024-11-25T19:32:16.692ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44722024-11-25T19:32:16.693ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d27fd871-0202-4cea-ac19-74490639f706", "content-length": "1", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
44732024-11-25T19:32:16.695ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44742024-11-25T19:32:16.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44752024-11-25T19:32:16.705ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44762024-11-25T19:32:16.753ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 551.871058ms iteration = 3 status = {}
44772024-11-25T19:32:16.778ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44782024-11-25T19:32:16.778ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f6990bb-0136-4bbc-a629-6158c0db5c6c", "content-length": "691", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
44792024-11-25T19:32:16.778ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
44802024-11-25T19:32:16.778ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
44812024-11-25T19:32:16.778ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
44822024-11-25T19:32:16.780ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 579.260915ms iteration = 3 status = {}
44832024-11-25T19:32:16.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44842024-11-25T19:32:16.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44852024-11-25T19:32:16.783ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 582.430067ms iteration = 3 status = null
44862024-11-25T19:32:16.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44872024-11-25T19:32:16.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44882024-11-25T19:32:16.788ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44892024-11-25T19:32:16.788ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44902024-11-25T19:32:16.788ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0ad5a0b0-a65c-42ad-a0f6-1ba1c2d609c8", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
44912024-11-25T19:32:16.790ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 588.994126ms iteration = 4 status = {}
44922024-11-25T19:32:16.800ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
44932024-11-25T19:32:16.800ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "22b2ee41-f3cb-450f-88d7-a231af8e288f", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
44942024-11-25T19:32:16.800ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
44952024-11-25T19:32:16.802ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b188d3e4-98ea-4ad3-8967-5694d62f0889", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
44962024-11-25T19:32:16.802ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
44972024-11-25T19:32:16.803ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "002a13ee-03ec-44cc-8844-f4fb1318890c", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
44982024-11-25T19:32:16.803ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
44992024-11-25T19:32:16.804ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
45002024-11-25T19:32:16.804ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 603.45425ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45012024-11-25T19:32:16.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45022024-11-25T19:32:16.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45032024-11-25T19:32:16.845ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
45042024-11-25T19:32:16.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45052024-11-25T19:32:16.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45062024-11-25T19:32:16.856ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45072024-11-25T19:32:16.857ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6328691-c552-48ab-8cc6-def00e27190e", "content-length": "134", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
45082024-11-25T19:32:16.857ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45092024-11-25T19:32:16.857ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
45102024-11-25T19:32:16.857ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45112024-11-25T19:32:16.857ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45122024-11-25T19:32:16.857ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45132024-11-25T19:32:16.857ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45142024-11-25T19:32:16.857ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45152024-11-25T19:32:16.857ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45162024-11-25T19:32:16.857ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45172024-11-25T19:32:16.857ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45182024-11-25T19:32:16.857ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
45192024-11-25T19:32:16.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45202024-11-25T19:32:16.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45212024-11-25T19:32:16.860ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45222024-11-25T19:32:16.860ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "95812b85-c7e9-4542-a65b-d1f160a2218d", "content-length": "2", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
45232024-11-25T19:32:16.860ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45242024-11-25T19:32:16.860ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "34dfa024-a006-4cc7-8c48-d1cdc47dc2ec", "content-length": "51", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
45252024-11-25T19:32:16.860ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
45262024-11-25T19:32:16.860ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45272024-11-25T19:32:16.998ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b473ba05-d436-46a4-b155-53708d5f7925", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
45282024-11-25T19:32:16.998ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
45292024-11-25T19:32:16.998ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45302024-11-25T19:32:16.999ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e77c49e6-502b-4dd4-bc67-d167f55dae2f", "content-length": "682", "date": "Mon, 25 Nov 2024 19:32:16 GMT"} })
45312024-11-25T19:32:16.999ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45322024-11-25T19:32:17.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45332024-11-25T19:32:17.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45342024-11-25T19:32:17.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45352024-11-25T19:32:17.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45362024-11-25T19:32:17.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45372024-11-25T19:32:17.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45382024-11-25T19:32:17.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45392024-11-25T19:32:17.024ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 823.697781ms iteration = 3 status = {}
45402024-11-25T19:32:17.289ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1365 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 8a33e3cf-d700-4b95-b234-cfd856e13fcb response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
45412024-11-25T19:32:17.616ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56216
45422024-11-25T19:32:17.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56216 req_id = d343e0eb-c9b7-4d58-860e-efccd185b671 roles = RoleSet { roles: {} } uri = /metrics/producers
45432024-11-25T19:32:17.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56216 req_id = d343e0eb-c9b7-4d58-860e-efccd185b671 resource = Database result = Ok(()) uri = /metrics/producers
45442024-11-25T19:32:17.656ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = d2d29ac8-9dfa-4f1f-be62-a88a71a6b2fa
45452024-11-25T19:32:17.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40247 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56216 req_id = d343e0eb-c9b7-4d58-860e-efccd185b671 response_code = 201 uri = /metrics/producers
45462024-11-25T19:32:23.496ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:60318
45472024-11-25T19:32:23.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60318 req_id = 0870efff-bdc1-4d4c-9e4d-d1517eb49138 roles = RoleSet { roles: {} } uri = /metrics/producers
45482024-11-25T19:32:23.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60318 req_id = 0870efff-bdc1-4d4c-9e4d-d1517eb49138 resource = Database result = Ok(()) uri = /metrics/producers
45492024-11-25T19:32:23.535ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 4626c149-3efd-47ab-bfa7-bdd3e9545fef
45502024-11-25T19:32:23.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37070 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60318 req_id = 0870efff-bdc1-4d4c-9e4d-d1517eb49138 response_code = 201 uri = /metrics/producers
45512024-11-25T19:32:26.201ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
45522024-11-25T19:32:26.201ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
45532024-11-25T19:32:26.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45542024-11-25T19:32:26.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45552024-11-25T19:32:26.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45562024-11-25T19:32:26.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45572024-11-25T19:32:26.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45582024-11-25T19:32:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45592024-11-25T19:32:26.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45602024-11-25T19:32:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45612024-11-25T19:32:26.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45622024-11-25T19:32:26.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45632024-11-25T19:32:26.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45642024-11-25T19:32:26.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
45652024-11-25T19:32:26.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45662024-11-25T19:32:26.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45672024-11-25T19:32:26.226ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
45682024-11-25T19:32:26.226ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.656474ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
45692024-11-25T19:32:26.234ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45702024-11-25T19:32:26.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45712024-11-25T19:32:26.265ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.833402ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45722024-11-25T19:32:27.289ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1311 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 18ff1936-cede-490e-8432-301944f94611 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
45732024-11-25T19:32:36.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
45742024-11-25T19:32:36.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
45752024-11-25T19:32:36.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45762024-11-25T19:32:36.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45772024-11-25T19:32:36.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45782024-11-25T19:32:36.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45792024-11-25T19:32:36.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45802024-11-25T19:32:36.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45812024-11-25T19:32:36.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45822024-11-25T19:32:36.206ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.446187ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45832024-11-25T19:32:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45842024-11-25T19:32:36.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45852024-11-25T19:32:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45862024-11-25T19:32:36.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45872024-11-25T19:32:36.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45882024-11-25T19:32:36.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45892024-11-25T19:32:36.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
45902024-11-25T19:32:36.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45912024-11-25T19:32:36.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45922024-11-25T19:32:36.222ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
45932024-11-25T19:32:36.222ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.491712ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
45942024-11-25T19:32:37.289ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1231 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 07f4211b-20ac-43b5-a7f2-41f3bd7d35b5 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
45952024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
45962024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45972024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
45982024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
45992024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
46002024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46012024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
46022024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46032024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46042024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
46052024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46062024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
46072024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
46082024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46092024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46102024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
46112024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
46122024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46132024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46142024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
46152024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
46162024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46172024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46182024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
46192024-11-25T19:32:46.202ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46202024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
46212024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46222024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46232024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
46242024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46252024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
46262024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46272024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
46282024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46292024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46302024-11-25T19:32:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46312024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46322024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46332024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46342024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46352024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46362024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46372024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46382024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46392024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46402024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46412024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46422024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46432024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46442024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46452024-11-25T19:32:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46462024-11-25T19:32:46.206ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46472024-11-25T19:32:46.206ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1191, tv_nsec: 753313866 } })
46482024-11-25T19:32:46.206ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
46492024-11-25T19:32:46.207ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.962187ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46502024-11-25T19:32:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46512024-11-25T19:32:46.207ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46522024-11-25T19:32:46.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46532024-11-25T19:32:46.210ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.460796ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
46542024-11-25T19:32:46.211ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46552024-11-25T19:32:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46562024-11-25T19:32:46.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46572024-11-25T19:32:46.212ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46582024-11-25T19:32:46.213ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1191, tv_nsec: 760676941 } })
46592024-11-25T19:32:46.213ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
46602024-11-25T19:32:46.213ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46612024-11-25T19:32:46.213ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46622024-11-25T19:32:46.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46632024-11-25T19:32:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46642024-11-25T19:32:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46652024-11-25T19:32:46.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46662024-11-25T19:32:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46672024-11-25T19:32:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46682024-11-25T19:32:46.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46692024-11-25T19:32:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46702024-11-25T19:32:46.216ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46712024-11-25T19:32:46.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46722024-11-25T19:32:46.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46732024-11-25T19:32:46.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46742024-11-25T19:32:46.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46752024-11-25T19:32:46.217ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46762024-11-25T19:32:46.217ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46772024-11-25T19:32:46.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46782024-11-25T19:32:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46792024-11-25T19:32:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46802024-11-25T19:32:46.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.734449ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
46812024-11-25T19:32:46.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1191, tv_nsec: 765669178 } })
46822024-11-25T19:32:46.218ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46832024-11-25T19:32:46.218ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
46842024-11-25T19:32:46.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46852024-11-25T19:32:46.220ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46862024-11-25T19:32:46.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46872024-11-25T19:32:46.233ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 31.426436ms iteration = 6 status = {"physical_disks_added":0}
46882024-11-25T19:32:46.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46892024-11-25T19:32:46.242ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46902024-11-25T19:32:46.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46912024-11-25T19:32:46.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46922024-11-25T19:32:46.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46932024-11-25T19:32:46.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46942024-11-25T19:32:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46952024-11-25T19:32:46.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46962024-11-25T19:32:46.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46972024-11-25T19:32:46.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46982024-11-25T19:32:46.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.474561ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46992024-11-25T19:32:46.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47002024-11-25T19:32:46.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47012024-11-25T19:32:46.252ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47022024-11-25T19:32:46.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.007471ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
47032024-11-25T19:32:46.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47042024-11-25T19:32:46.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47052024-11-25T19:32:46.255ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47062024-11-25T19:32:46.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47072024-11-25T19:32:46.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47082024-11-25T19:32:46.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47092024-11-25T19:32:46.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47102024-11-25T19:32:46.257ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47112024-11-25T19:32:46.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47122024-11-25T19:32:46.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47132024-11-25T19:32:46.258ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.415397ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47142024-11-25T19:32:46.259ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47152024-11-25T19:32:46.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47162024-11-25T19:32:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
47172024-11-25T19:32:46.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47182024-11-25T19:32:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47192024-11-25T19:32:46.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47202024-11-25T19:32:46.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47212024-11-25T19:32:46.264ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47222024-11-25T19:32:46.264ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47232024-11-25T19:32:46.264ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 61.433365ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47242024-11-25T19:32:46.266ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47252024-11-25T19:32:46.266ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.303932ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47262024-11-25T19:32:46.273ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
47272024-11-25T19:32:46.273ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.872041ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
47282024-11-25T19:32:46.283ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47292024-11-25T19:32:46.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47302024-11-25T19:32:46.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 82.904166ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47312024-11-25T19:32:46.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47322024-11-25T19:32:46.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47332024-11-25T19:32:46.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47342024-11-25T19:32:46.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
47352024-11-25T19:32:46.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47362024-11-25T19:32:46.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47372024-11-25T19:32:46.291ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.252431ms iteration = 4 status = 0
47382024-11-25T19:32:46.293ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
47392024-11-25T19:32:46.293ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47402024-11-25T19:32:46.294ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "27d0695d-5742-4fb8-9ab5-2db0b56a7b09", "content-length": "26", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
47412024-11-25T19:32:46.294ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47422024-11-25T19:32:46.295ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47432024-11-25T19:32:46.306ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
47442024-11-25T19:32:46.306ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47452024-11-25T19:32:46.306ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1693ee8f-603f-4259-a85b-a3bdb9078b1c", "content-length": "26", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
47462024-11-25T19:32:46.306ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47472024-11-25T19:32:46.307ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47482024-11-25T19:32:46.312ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
47492024-11-25T19:32:46.312ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47502024-11-25T19:32:46.312ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3576d560-605c-4200-b776-16d9530b12fc", "content-length": "26", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
47512024-11-25T19:32:46.312ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47522024-11-25T19:32:46.314ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
47532024-11-25T19:32:46.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47542024-11-25T19:32:46.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47552024-11-25T19:32:46.353ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47562024-11-25T19:32:46.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47572024-11-25T19:32:46.354ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47582024-11-25T19:32:46.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47592024-11-25T19:32:46.356ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47602024-11-25T19:32:46.358ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47612024-11-25T19:32:46.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47622024-11-25T19:32:46.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47632024-11-25T19:32:46.436ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47642024-11-25T19:32:46.436ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47652024-11-25T19:32:46.436ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "994d2bef-6f18-4c56-b83b-5b108e08c221", "content-length": "372", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
47662024-11-25T19:32:46.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47672024-11-25T19:32:46.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47682024-11-25T19:32:46.482ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
47692024-11-25T19:32:46.482ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47702024-11-25T19:32:46.482ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f94901bf-b090-4b96-b839-56f75ca8aedd", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
47712024-11-25T19:32:46.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47722024-11-25T19:32:46.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47732024-11-25T19:32:46.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47742024-11-25T19:32:46.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47752024-11-25T19:32:46.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47762024-11-25T19:32:46.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47772024-11-25T19:32:46.494ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47782024-11-25T19:32:46.494ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47792024-11-25T19:32:46.495ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d3d23658-c18c-48de-b62d-b631a39e8a92", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
47802024-11-25T19:32:46.496ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 293.939017ms iteration = 5 status = {}
47812024-11-25T19:32:46.514ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 311.830098ms iteration = 4 status = {}
47822024-11-25T19:32:46.521ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47832024-11-25T19:32:46.522ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8259836-bcea-4631-9867-29e95cbb4ee6", "content-length": "1", "date": "Mon, 25 Nov 2024 19:32:45 GMT"} })
47842024-11-25T19:32:46.523ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47852024-11-25T19:32:46.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47862024-11-25T19:32:46.540ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47872024-11-25T19:32:46.540ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d7fbd80-9c71-42c1-a2d8-62d2d9e02fe3", "content-length": "691", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
47882024-11-25T19:32:46.540ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
47892024-11-25T19:32:46.540ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
47902024-11-25T19:32:46.540ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
47912024-11-25T19:32:46.542ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 339.510452ms iteration = 4 status = {}
47922024-11-25T19:32:46.542ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 340.366998ms iteration = 4 status = null
47932024-11-25T19:32:46.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47942024-11-25T19:32:46.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47952024-11-25T19:32:46.571ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
47962024-11-25T19:32:46.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47972024-11-25T19:32:46.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47982024-11-25T19:32:46.581ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47992024-11-25T19:32:46.581ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3048dad6-58ce-4fe0-9e6b-d7977a7d6381", "content-length": "134", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
48002024-11-25T19:32:46.582ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48012024-11-25T19:32:46.582ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
48022024-11-25T19:32:46.582ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48032024-11-25T19:32:46.582ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48042024-11-25T19:32:46.582ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48052024-11-25T19:32:46.582ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48062024-11-25T19:32:46.582ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48072024-11-25T19:32:46.582ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48082024-11-25T19:32:46.582ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48092024-11-25T19:32:46.582ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48102024-11-25T19:32:46.582ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
48112024-11-25T19:32:46.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48122024-11-25T19:32:46.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48132024-11-25T19:32:46.585ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48142024-11-25T19:32:46.585ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "525bb811-617c-4e1d-b411-817b12eff9f4", "content-length": "2", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
48152024-11-25T19:32:46.585ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48162024-11-25T19:32:46.585ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9931e44b-5079-4368-98c8-29b548c824e2", "content-length": "51", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
48172024-11-25T19:32:46.585ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
48182024-11-25T19:32:46.585ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48192024-11-25T19:32:46.675ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4efb2786-3856-415e-a694-a4c1b79dceef", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
48202024-11-25T19:32:46.675ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
48212024-11-25T19:32:46.675ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48222024-11-25T19:32:46.675ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "47481984-646c-4b13-b032-38aa5ee9c688", "content-length": "682", "date": "Mon, 25 Nov 2024 19:32:46 GMT"} })
48232024-11-25T19:32:46.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48242024-11-25T19:32:46.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48252024-11-25T19:32:46.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48262024-11-25T19:32:46.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48272024-11-25T19:32:46.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48282024-11-25T19:32:46.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48292024-11-25T19:32:46.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48302024-11-25T19:32:46.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48312024-11-25T19:32:46.691ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 488.661408ms iteration = 4 status = {}
48322024-11-25T19:32:47.289ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1140 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = d9224e2c-7e7d-40f6-9415-37fb73b49c34 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
48332024-11-25T19:32:56.201ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
48342024-11-25T19:32:56.201ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
48352024-11-25T19:32:56.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48362024-11-25T19:32:56.201ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48372024-11-25T19:32:56.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48382024-11-25T19:32:56.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48392024-11-25T19:32:56.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48402024-11-25T19:32:56.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48412024-11-25T19:32:56.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48422024-11-25T19:32:56.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48432024-11-25T19:32:56.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48442024-11-25T19:32:56.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48452024-11-25T19:32:56.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48462024-11-25T19:32:56.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
48472024-11-25T19:32:56.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48482024-11-25T19:32:56.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48492024-11-25T19:32:56.224ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
48502024-11-25T19:32:56.224ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.777587ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
48512024-11-25T19:32:56.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48522024-11-25T19:32:56.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48532024-11-25T19:32:56.231ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.002529ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48542024-11-25T19:32:57.289ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1157 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 6bbe669c-9259-4c25-8252-c98236504161 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
48552024-11-25T19:33:06.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
48562024-11-25T19:33:06.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48572024-11-25T19:33:06.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
48582024-11-25T19:33:06.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48592024-11-25T19:33:06.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48602024-11-25T19:33:06.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48612024-11-25T19:33:06.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48622024-11-25T19:33:06.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48632024-11-25T19:33:06.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48642024-11-25T19:33:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48652024-11-25T19:33:06.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48662024-11-25T19:33:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48672024-11-25T19:33:06.206ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.737603ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48682024-11-25T19:33:06.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48692024-11-25T19:33:06.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48702024-11-25T19:33:06.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48712024-11-25T19:33:06.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
48722024-11-25T19:33:06.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48732024-11-25T19:33:06.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48742024-11-25T19:33:06.224ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
48752024-11-25T19:33:06.224ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.023202ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
48762024-11-25T19:33:07.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37852 req_id = cb0bcb9a-70e7-4366-8d31-f168e6676930 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
48772024-11-25T19:33:07.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37852 req_id = cb0bcb9a-70e7-4366-8d31-f168e6676930 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
48782024-11-25T19:33:07.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37852 req_id = cb0bcb9a-70e7-4366-8d31-f168e6676930 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
48792024-11-25T19:33:07.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37852 req_id = 05543207-f391-4cba-a832-04bbb1a0d06f roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
48802024-11-25T19:33:07.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37852 req_id = 05543207-f391-4cba-a832-04bbb1a0d06f resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
48812024-11-25T19:33:07.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37852 req_id = 05543207-f391-4cba-a832-04bbb1a0d06f response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
48822024-11-25T19:33:07.289ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1034 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 775caddd-1856-4891-aaa1-74519f03d0a1 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
48832024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
48842024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
48852024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48862024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
48872024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48882024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48892024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
48902024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48912024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
48922024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48932024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
48942024-11-25T19:33:16.202ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48952024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
48962024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48972024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48982024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
48992024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49002024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
49012024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49022024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
49032024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49042024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49052024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
49062024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
49072024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
49082024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49092024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
49102024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
49112024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
49122024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49132024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
49142024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49152024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
49162024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
49172024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49182024-11-25T19:33:16.202ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
49192024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49202024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
49212024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
49222024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49232024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
49242024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49252024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
49262024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
49272024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
49282024-11-25T19:33:16.202ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:23:16.202398432 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
49292024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
49302024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49312024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
49322024-11-25T19:33:16.202ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
49332024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.81\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
49342024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
49352024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49362024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
49372024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
49382024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49392024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
49402024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
49412024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49422024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49432024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
49442024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
49452024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49462024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
49472024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49482024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49492024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49502024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
49512024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49522024-11-25T19:33:16.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49532024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49542024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49552024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49562024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49572024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49582024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
49592024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49602024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49612024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49622024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49632024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49642024-11-25T19:33:16.203ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1221, tv_nsec: 750042592 } })
49652024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49662024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49672024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49682024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49692024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
49702024-11-25T19:33:16.203ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1221, tv_nsec: 750188064 } })
49712024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
49722024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.156643ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
49732024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
49742024-11-25T19:33:16.203ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.482839ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
49752024-11-25T19:33:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.06509ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
49762024-11-25T19:33:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.461448ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
49772024-11-25T19:33:16.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49782024-11-25T19:33:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.200002ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49792024-11-25T19:33:16.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49802024-11-25T19:33:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49812024-11-25T19:33:16.207ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49822024-11-25T19:33:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49832024-11-25T19:33:16.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49842024-11-25T19:33:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49852024-11-25T19:33:16.209ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49862024-11-25T19:33:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49872024-11-25T19:33:16.209ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49882024-11-25T19:33:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49892024-11-25T19:33:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49902024-11-25T19:33:16.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49912024-11-25T19:33:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49922024-11-25T19:33:16.210ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49932024-11-25T19:33:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49942024-11-25T19:33:16.210ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49952024-11-25T19:33:16.210ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49962024-11-25T19:33:16.210ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49972024-11-25T19:33:16.210ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49982024-11-25T19:33:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49992024-11-25T19:33:16.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1221, tv_nsec: 758509268 } })
50002024-11-25T19:33:16.211ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.275242ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
50012024-11-25T19:33:16.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
50022024-11-25T19:33:16.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50032024-11-25T19:33:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50042024-11-25T19:33:16.212ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50052024-11-25T19:33:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50062024-11-25T19:33:16.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50072024-11-25T19:33:16.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50082024-11-25T19:33:16.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50092024-11-25T19:33:16.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50102024-11-25T19:33:16.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50112024-11-25T19:33:16.214ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50122024-11-25T19:33:16.214ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1221, tv_nsec: 761917865 } })
50132024-11-25T19:33:16.215ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
50142024-11-25T19:33:16.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50152024-11-25T19:33:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
50162024-11-25T19:33:16.215ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50172024-11-25T19:33:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50182024-11-25T19:33:16.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50192024-11-25T19:33:16.217ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50202024-11-25T19:33:16.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50212024-11-25T19:33:16.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50222024-11-25T19:33:16.218ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:23:16.202398432 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
50232024-11-25T19:33:16.218ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.992634ms iteration = 3 status = {"expiration":"2024-11-25T19:23:16.202398432Z","pruned":[]}
50242024-11-25T19:33:16.219ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1221, tv_nsec: 766618847 } })
50252024-11-25T19:33:16.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
50262024-11-25T19:33:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50272024-11-25T19:33:16.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50282024-11-25T19:33:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50292024-11-25T19:33:16.226ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50302024-11-25T19:33:16.226ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50312024-11-25T19:33:16.226ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50322024-11-25T19:33:16.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50332024-11-25T19:33:16.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50342024-11-25T19:33:16.226ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50352024-11-25T19:33:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50362024-11-25T19:33:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50372024-11-25T19:33:16.228ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50382024-11-25T19:33:16.229ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50392024-11-25T19:33:16.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50402024-11-25T19:33:16.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50412024-11-25T19:33:16.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50422024-11-25T19:33:16.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50432024-11-25T19:33:16.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50442024-11-25T19:33:16.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50452024-11-25T19:33:16.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50462024-11-25T19:33:16.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50472024-11-25T19:33:16.233ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50482024-11-25T19:33:16.233ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50492024-11-25T19:33:16.233ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50502024-11-25T19:33:16.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50512024-11-25T19:33:16.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50522024-11-25T19:33:16.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50532024-11-25T19:33:16.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
50542024-11-25T19:33:16.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50552024-11-25T19:33:16.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50562024-11-25T19:33:16.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50572024-11-25T19:33:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50582024-11-25T19:33:16.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50592024-11-25T19:33:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50602024-11-25T19:33:16.248ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
50612024-11-25T19:33:16.248ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
50622024-11-25T19:33:16.248ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 46.019333ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
50632024-11-25T19:33:16.252ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50642024-11-25T19:33:16.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50652024-11-25T19:33:16.254ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50662024-11-25T19:33:16.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50672024-11-25T19:33:16.255ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
50682024-11-25T19:33:16.255ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.059181ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
50692024-11-25T19:33:16.264ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
50702024-11-25T19:33:16.264ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
50712024-11-25T19:33:16.264ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
50722024-11-25T19:33:16.264ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50732024-11-25T19:33:16.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50742024-11-25T19:33:16.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50752024-11-25T19:33:16.266ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50762024-11-25T19:33:16.268ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50772024-11-25T19:33:16.268ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50782024-11-25T19:33:16.268ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 65.985244ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50792024-11-25T19:33:16.268ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50802024-11-25T19:33:16.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50812024-11-25T19:33:16.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50822024-11-25T19:33:16.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50832024-11-25T19:33:16.269ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50842024-11-25T19:33:16.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50852024-11-25T19:33:16.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50862024-11-25T19:33:16.270ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.929893ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50872024-11-25T19:33:16.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50882024-11-25T19:33:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50892024-11-25T19:33:16.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50902024-11-25T19:33:16.270ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.509944ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50912024-11-25T19:33:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50922024-11-25T19:33:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50932024-11-25T19:33:16.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50942024-11-25T19:33:16.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50952024-11-25T19:33:16.272ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50962024-11-25T19:33:16.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50972024-11-25T19:33:16.273ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
50982024-11-25T19:33:16.273ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
50992024-11-25T19:33:16.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51002024-11-25T19:33:16.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51012024-11-25T19:33:16.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51022024-11-25T19:33:16.274ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
51032024-11-25T19:33:16.274ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
51042024-11-25T19:33:16.274ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.205856ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
51052024-11-25T19:33:16.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51062024-11-25T19:33:16.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.91311ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51072024-11-25T19:33:16.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51082024-11-25T19:33:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
51092024-11-25T19:33:16.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51102024-11-25T19:33:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51112024-11-25T19:33:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51122024-11-25T19:33:16.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51132024-11-25T19:33:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51142024-11-25T19:33:16.278ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51152024-11-25T19:33:16.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
51162024-11-25T19:33:16.279ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51172024-11-25T19:33:16.279ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 76.851698ms iteration = 5 status = 0
51182024-11-25T19:33:16.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51192024-11-25T19:33:16.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51202024-11-25T19:33:16.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51212024-11-25T19:33:16.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51222024-11-25T19:33:16.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51232024-11-25T19:33:16.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51242024-11-25T19:33:16.285ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51252024-11-25T19:33:16.285ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
51262024-11-25T19:33:16.285ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
51272024-11-25T19:33:16.285ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51282024-11-25T19:33:16.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51292024-11-25T19:33:16.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51302024-11-25T19:33:16.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51312024-11-25T19:33:16.285ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
51322024-11-25T19:33:16.285ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
51332024-11-25T19:33:16.285ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
51342024-11-25T19:33:16.285ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 83.442678ms iteration = 4 status = {"generation":1}
51352024-11-25T19:33:16.285ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51362024-11-25T19:33:16.285ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.685642ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51372024-11-25T19:33:16.287ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51382024-11-25T19:33:16.287ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51392024-11-25T19:33:16.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51402024-11-25T19:33:16.289ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51412024-11-25T19:33:16.289ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51422024-11-25T19:33:16.289ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51432024-11-25T19:33:16.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51442024-11-25T19:33:16.292ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51452024-11-25T19:33:16.292ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51462024-11-25T19:33:16.292ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51472024-11-25T19:33:16.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51482024-11-25T19:33:16.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51492024-11-25T19:33:16.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51502024-11-25T19:33:16.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51512024-11-25T19:33:16.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51522024-11-25T19:33:16.294ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
51532024-11-25T19:33:16.294ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51542024-11-25T19:33:16.294ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
51552024-11-25T19:33:16.294ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 91.920543ms iteration = 4 status = {"generation":2}
51562024-11-25T19:33:16.299ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
51572024-11-25T19:33:16.299ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 97.176317ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
51582024-11-25T19:33:16.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 97.409041ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
51592024-11-25T19:33:16.303ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
51602024-11-25T19:33:16.303ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 101.185895ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51612024-11-25T19:33:16.355ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
51622024-11-25T19:33:16.355ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51632024-11-25T19:33:16.356ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56da07c2-c195-4969-91dc-3f133cc0a1a1", "content-length": "26", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
51642024-11-25T19:33:16.356ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51652024-11-25T19:33:16.357ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51662024-11-25T19:33:16.357ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
51672024-11-25T19:33:16.357ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51682024-11-25T19:33:16.357ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "69150a3a-3b29-42a2-90b2-e065f3813eda", "content-length": "26", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
51692024-11-25T19:33:16.357ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51702024-11-25T19:33:16.359ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51712024-11-25T19:33:16.361ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
51722024-11-25T19:33:16.392ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 189.709563ms iteration = 7 status = {"physical_disks_added":0}
51732024-11-25T19:33:16.501ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
51742024-11-25T19:33:16.522ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
51752024-11-25T19:33:16.522ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51762024-11-25T19:33:16.523ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f6dba25-9eb7-41f3-aa12-ca30d1ce7705", "content-length": "26", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
51772024-11-25T19:33:16.523ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51782024-11-25T19:33:16.524ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
51792024-11-25T19:33:16.553ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51802024-11-25T19:33:16.553ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e2671a1-edaa-4e64-9c0d-c655109024c8", "content-length": "691", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
51812024-11-25T19:33:16.553ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
51822024-11-25T19:33:16.553ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
51832024-11-25T19:33:16.553ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
51842024-11-25T19:33:16.555ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 353.160279ms iteration = 5 status = {}
51852024-11-25T19:33:16.560ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51862024-11-25T19:33:16.560ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51872024-11-25T19:33:16.560ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c0be93d-8f19-4e0b-a2e5-42ba1226e8f4", "content-length": "372", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
51882024-11-25T19:33:16.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51892024-11-25T19:33:16.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51902024-11-25T19:33:16.574ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
51912024-11-25T19:33:16.574ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51922024-11-25T19:33:16.574ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "25cdbe2b-9dbe-40c5-9787-df714b41510f", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
51932024-11-25T19:33:16.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51942024-11-25T19:33:16.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51952024-11-25T19:33:16.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51962024-11-25T19:33:16.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51972024-11-25T19:33:16.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51982024-11-25T19:33:16.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51992024-11-25T19:33:16.581ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52002024-11-25T19:33:16.581ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52012024-11-25T19:33:16.582ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "168ea6ce-c5a4-44c5-a77b-c8ce43380be0", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
52022024-11-25T19:33:16.583ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 380.907223ms iteration = 6 status = {}
52032024-11-25T19:33:16.595ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
52042024-11-25T19:33:16.595ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9f58a4dc-8091-41c4-9eec-a9e72be232a8", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52052024-11-25T19:33:16.595ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52062024-11-25T19:33:16.597ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7a56eb21-9ba4-4c99-abaf-cd1d4dab6c5a", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52072024-11-25T19:33:16.597ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52082024-11-25T19:33:16.597ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52092024-11-25T19:33:16.597ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 395.613302ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
52102024-11-25T19:33:16.640ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 437.913472ms iteration = 5 status = {}
52112024-11-25T19:33:16.641ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
52122024-11-25T19:33:16.650ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52132024-11-25T19:33:16.650ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fc2df1d-a01e-4461-bb16-de8f65792853", "content-length": "1", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
52142024-11-25T19:33:16.652ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52152024-11-25T19:33:16.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52162024-11-25T19:33:16.654ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 452.527099ms iteration = 5 status = null
52172024-11-25T19:33:16.700ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
52182024-11-25T19:33:16.701ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6e83651b-8224-434b-a6bb-ca85d0319475", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52192024-11-25T19:33:16.701ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52202024-11-25T19:33:16.702ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ea78b4b6-1c77-4128-a23e-9b7b16898376", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52212024-11-25T19:33:16.702ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52222024-11-25T19:33:16.703ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "378168b5-ff1f-41cc-aff0-1f7cd31a4ce9", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52232024-11-25T19:33:16.703ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52242024-11-25T19:33:16.705ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
52252024-11-25T19:33:16.705ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 502.941098ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
52262024-11-25T19:33:16.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52272024-11-25T19:33:16.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52282024-11-25T19:33:16.732ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
52292024-11-25T19:33:16.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52302024-11-25T19:33:16.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52312024-11-25T19:33:16.741ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52322024-11-25T19:33:16.741ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a926e81-2d65-42a5-8ba1-f7dc9126abac", "content-length": "134", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
52332024-11-25T19:33:16.741ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
52342024-11-25T19:33:16.741ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
52352024-11-25T19:33:16.741ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52362024-11-25T19:33:16.741ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52372024-11-25T19:33:16.741ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52382024-11-25T19:33:16.741ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52392024-11-25T19:33:16.741ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52402024-11-25T19:33:16.741ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52412024-11-25T19:33:16.741ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52422024-11-25T19:33:16.741ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52432024-11-25T19:33:16.742ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
52442024-11-25T19:33:16.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52452024-11-25T19:33:16.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52462024-11-25T19:33:16.743ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52472024-11-25T19:33:16.743ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4e16dbe-1283-4376-b7ca-14c5bd3de8d2", "content-length": "2", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
52482024-11-25T19:33:16.743ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52492024-11-25T19:33:16.743ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a953f19-2a9a-4afe-b5a1-db466c771293", "content-length": "51", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
52502024-11-25T19:33:16.743ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
52512024-11-25T19:33:16.743ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52522024-11-25T19:33:16.836ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a85964bc-da11-4ef4-8620-c4c4780c4d23", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
52532024-11-25T19:33:16.837ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
52542024-11-25T19:33:16.837ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52552024-11-25T19:33:16.837ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a6a9f5d-99b0-4722-b32f-bcbb9968c8ae", "content-length": "682", "date": "Mon, 25 Nov 2024 19:33:16 GMT"} })
52562024-11-25T19:33:16.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52572024-11-25T19:33:16.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52582024-11-25T19:33:16.840ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52592024-11-25T19:33:16.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52602024-11-25T19:33:16.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52612024-11-25T19:33:16.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52622024-11-25T19:33:16.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52632024-11-25T19:33:16.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52642024-11-25T19:33:16.853ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 651.40594ms iteration = 5 status = {}
52652024-11-25T19:33:17.289ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1148 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 12c59f5e-1051-4fd3-9817-99d0a6240126 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
52662024-11-25T19:33:26.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
52672024-11-25T19:33:26.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52682024-11-25T19:33:26.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
52692024-11-25T19:33:26.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52702024-11-25T19:33:26.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52712024-11-25T19:33:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52722024-11-25T19:33:26.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52732024-11-25T19:33:26.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52742024-11-25T19:33:26.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52752024-11-25T19:33:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52762024-11-25T19:33:26.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52772024-11-25T19:33:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52782024-11-25T19:33:26.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52792024-11-25T19:33:26.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52802024-11-25T19:33:26.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52812024-11-25T19:33:26.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
52822024-11-25T19:33:26.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52832024-11-25T19:33:26.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52842024-11-25T19:33:26.222ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
52852024-11-25T19:33:26.222ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.324769ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
52862024-11-25T19:33:26.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.07858ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52872024-11-25T19:33:27.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1322 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 155e2015-8b67-4118-9eb8-7fb9b8972432 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
52882024-11-25T19:33:36.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
52892024-11-25T19:33:36.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52902024-11-25T19:33:36.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
52912024-11-25T19:33:36.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52922024-11-25T19:33:36.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52932024-11-25T19:33:36.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52942024-11-25T19:33:36.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52952024-11-25T19:33:36.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52962024-11-25T19:33:36.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52972024-11-25T19:33:36.206ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.776714ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52982024-11-25T19:33:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52992024-11-25T19:33:36.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53002024-11-25T19:33:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53012024-11-25T19:33:36.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53022024-11-25T19:33:36.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53032024-11-25T19:33:36.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53042024-11-25T19:33:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
53052024-11-25T19:33:36.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53062024-11-25T19:33:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53072024-11-25T19:33:36.224ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
53082024-11-25T19:33:36.224ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.824478ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
53092024-11-25T19:33:37.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1126 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = e6c93e46-164a-4a72-9fc4-a3aef64d1ee3 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
53102024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
53112024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53122024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
53132024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53142024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
53152024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
53162024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53172024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53182024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
53192024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
53202024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53212024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
53222024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
53232024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53242024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53252024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
53262024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53272024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
53282024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
53292024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53302024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53312024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
53322024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53332024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
53342024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53352024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
53362024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53372024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
53382024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53392024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53402024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
53412024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53422024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
53432024-11-25T19:33:46.202ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53442024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53452024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53462024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53472024-11-25T19:33:46.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53482024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53492024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53502024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53512024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53522024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53532024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53542024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53552024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53562024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53572024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53582024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53592024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53602024-11-25T19:33:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53612024-11-25T19:33:46.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53622024-11-25T19:33:46.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53632024-11-25T19:33:46.205ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.302615ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53642024-11-25T19:33:46.205ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1251, tv_nsec: 752725224 } })
53652024-11-25T19:33:46.206ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
53662024-11-25T19:33:46.207ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1251, tv_nsec: 753801305 } })
53672024-11-25T19:33:46.207ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
53682024-11-25T19:33:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53692024-11-25T19:33:46.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53702024-11-25T19:33:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53712024-11-25T19:33:46.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53722024-11-25T19:33:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53732024-11-25T19:33:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53742024-11-25T19:33:46.209ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53752024-11-25T19:33:46.209ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53762024-11-25T19:33:46.210ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53772024-11-25T19:33:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53782024-11-25T19:33:46.211ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53792024-11-25T19:33:46.211ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53802024-11-25T19:33:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53812024-11-25T19:33:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53822024-11-25T19:33:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53832024-11-25T19:33:46.212ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53842024-11-25T19:33:46.212ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53852024-11-25T19:33:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53862024-11-25T19:33:46.212ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53872024-11-25T19:33:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53882024-11-25T19:33:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53892024-11-25T19:33:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53902024-11-25T19:33:46.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53912024-11-25T19:33:46.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53922024-11-25T19:33:46.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53932024-11-25T19:33:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53942024-11-25T19:33:46.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53952024-11-25T19:33:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53962024-11-25T19:33:46.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53972024-11-25T19:33:46.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53982024-11-25T19:33:46.220ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1251, tv_nsec: 767702168 } })
53992024-11-25T19:33:46.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54002024-11-25T19:33:46.221ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
54012024-11-25T19:33:46.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54022024-11-25T19:33:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54032024-11-25T19:33:46.221ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54042024-11-25T19:33:46.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54052024-11-25T19:33:46.224ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54062024-11-25T19:33:46.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54072024-11-25T19:33:46.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54082024-11-25T19:33:46.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54092024-11-25T19:33:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54102024-11-25T19:33:46.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.988713ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54112024-11-25T19:33:46.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.035134ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
54122024-11-25T19:33:46.247ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54132024-11-25T19:33:46.247ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54142024-11-25T19:33:46.247ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54152024-11-25T19:33:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54162024-11-25T19:33:46.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.105483ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
54172024-11-25T19:33:46.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54182024-11-25T19:33:46.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54192024-11-25T19:33:46.258ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54202024-11-25T19:33:46.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54212024-11-25T19:33:46.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54222024-11-25T19:33:46.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54232024-11-25T19:33:46.260ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 57.703232ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54242024-11-25T19:33:46.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54252024-11-25T19:33:46.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54262024-11-25T19:33:46.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.677391ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54272024-11-25T19:33:46.263ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54282024-11-25T19:33:46.263ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.66792ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54292024-11-25T19:33:46.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
54302024-11-25T19:33:46.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54312024-11-25T19:33:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54322024-11-25T19:33:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
54332024-11-25T19:33:46.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54342024-11-25T19:33:46.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54352024-11-25T19:33:46.266ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54362024-11-25T19:33:46.267ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.653218ms iteration = 6 status = 0
54372024-11-25T19:33:46.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54382024-11-25T19:33:46.268ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54392024-11-25T19:33:46.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54402024-11-25T19:33:46.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 66.467325ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
54412024-11-25T19:33:46.273ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54422024-11-25T19:33:46.273ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54432024-11-25T19:33:46.274ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf113f00-f61f-4ef6-95a7-3381c2c47139", "content-length": "26", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
54442024-11-25T19:33:46.274ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54452024-11-25T19:33:46.276ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54462024-11-25T19:33:46.277ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54472024-11-25T19:33:46.277ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54482024-11-25T19:33:46.277ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "51b17a14-742d-4054-b669-f7076dbd313f", "content-length": "26", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
54492024-11-25T19:33:46.277ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54502024-11-25T19:33:46.278ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
54512024-11-25T19:33:46.278ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.898099ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
54522024-11-25T19:33:46.279ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54532024-11-25T19:33:46.291ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54542024-11-25T19:33:46.292ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54552024-11-25T19:33:46.292ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54562024-11-25T19:33:46.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54572024-11-25T19:33:46.305ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
54582024-11-25T19:33:46.305ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54592024-11-25T19:33:46.305ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "21b80e7e-ad77-45c1-9292-92bd79e8b13d", "content-length": "26", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
54602024-11-25T19:33:46.305ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54612024-11-25T19:33:46.309ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
54622024-11-25T19:33:46.325ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54632024-11-25T19:33:46.325ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54642024-11-25T19:33:46.325ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.592045ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54652024-11-25T19:33:46.334ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54662024-11-25T19:33:46.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54672024-11-25T19:33:46.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54682024-11-25T19:33:46.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54692024-11-25T19:33:46.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54702024-11-25T19:33:46.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54712024-11-25T19:33:46.347ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54722024-11-25T19:33:46.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54732024-11-25T19:33:46.349ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54742024-11-25T19:33:46.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54752024-11-25T19:33:46.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54762024-11-25T19:33:46.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54772024-11-25T19:33:46.359ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.94787ms iteration = 8 status = {"physical_disks_added":0}
54782024-11-25T19:33:46.386ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54792024-11-25T19:33:46.386ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0539ffb2-5cd8-45e5-ac36-251edec91fa4", "content-length": "1", "date": "Mon, 25 Nov 2024 19:33:45 GMT"} })
54802024-11-25T19:33:46.387ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 184.602572ms iteration = 6 status = {}
54812024-11-25T19:33:46.388ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54822024-11-25T19:33:46.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54832024-11-25T19:33:46.390ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 187.790274ms iteration = 6 status = null
54842024-11-25T19:33:46.412ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54852024-11-25T19:33:46.412ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54862024-11-25T19:33:46.413ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "640b2a8d-df70-4a88-8b13-9a2c8a066ceb", "content-length": "372", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
54872024-11-25T19:33:46.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54882024-11-25T19:33:46.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54892024-11-25T19:33:46.430ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
54902024-11-25T19:33:46.430ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54912024-11-25T19:33:46.430ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9c0028c9-99bc-4e0d-b2f7-b666ca4ed698", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
54922024-11-25T19:33:46.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54932024-11-25T19:33:46.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54942024-11-25T19:33:46.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54952024-11-25T19:33:46.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54962024-11-25T19:33:46.437ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54972024-11-25T19:33:46.437ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c00f9a2-b094-4bb4-ad88-b7d52a72dda6", "content-length": "691", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
54982024-11-25T19:33:46.437ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
54992024-11-25T19:33:46.437ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
55002024-11-25T19:33:46.437ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
55012024-11-25T19:33:46.438ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 236.308947ms iteration = 6 status = {}
55022024-11-25T19:33:46.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55032024-11-25T19:33:46.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55042024-11-25T19:33:46.442ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55052024-11-25T19:33:46.442ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55062024-11-25T19:33:46.443ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "84f99b1f-caf6-4fda-b5ff-8f38bf6d8d94", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
55072024-11-25T19:33:46.444ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 241.335695ms iteration = 7 status = {}
55082024-11-25T19:33:46.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55092024-11-25T19:33:46.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55102024-11-25T19:33:46.489ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
55112024-11-25T19:33:46.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55122024-11-25T19:33:46.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55132024-11-25T19:33:46.499ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55142024-11-25T19:33:46.499ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "54e1f55f-ab05-4492-be3b-8f2e9c8c3562", "content-length": "134", "date": "Mon, 25 Nov 2024 19:33:45 GMT"} })
55152024-11-25T19:33:46.499ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55162024-11-25T19:33:46.499ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
55172024-11-25T19:33:46.499ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55182024-11-25T19:33:46.499ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55192024-11-25T19:33:46.499ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55202024-11-25T19:33:46.499ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55212024-11-25T19:33:46.499ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55222024-11-25T19:33:46.499ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55232024-11-25T19:33:46.500ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55242024-11-25T19:33:46.500ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55252024-11-25T19:33:46.500ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
55262024-11-25T19:33:46.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55272024-11-25T19:33:46.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55282024-11-25T19:33:46.501ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55292024-11-25T19:33:46.501ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8fc67a6-55c0-49ff-b7e4-5d33b3ebda64", "content-length": "2", "date": "Mon, 25 Nov 2024 19:33:45 GMT"} })
55302024-11-25T19:33:46.501ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55312024-11-25T19:33:46.501ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6a56a26-4af5-41f6-9f2d-b64c578cfbcd", "content-length": "51", "date": "Mon, 25 Nov 2024 19:33:45 GMT"} })
55322024-11-25T19:33:46.501ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
55332024-11-25T19:33:46.501ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55342024-11-25T19:33:46.586ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8fdc1ce7-d3b1-48cd-bfd3-5fd7d073eaa5", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
55352024-11-25T19:33:46.586ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
55362024-11-25T19:33:46.586ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55372024-11-25T19:33:46.586ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fe5de87-c6cd-483a-88ae-0796a5707c9e", "content-length": "682", "date": "Mon, 25 Nov 2024 19:33:46 GMT"} })
55382024-11-25T19:33:46.586ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55392024-11-25T19:33:46.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55402024-11-25T19:33:46.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55412024-11-25T19:33:46.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55422024-11-25T19:33:46.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55432024-11-25T19:33:46.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55442024-11-25T19:33:46.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55452024-11-25T19:33:46.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55462024-11-25T19:33:46.601ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 399.155752ms iteration = 6 status = {}
55472024-11-25T19:33:47.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1195 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = d2b4d746-bb5e-439b-bca0-cfe33571721c response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
55482024-11-25T19:33:56.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
55492024-11-25T19:33:56.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
55502024-11-25T19:33:56.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55512024-11-25T19:33:56.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55522024-11-25T19:33:56.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55532024-11-25T19:33:56.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55542024-11-25T19:33:56.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55552024-11-25T19:33:56.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55562024-11-25T19:33:56.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55572024-11-25T19:33:56.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55582024-11-25T19:33:56.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55592024-11-25T19:33:56.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55602024-11-25T19:33:56.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55612024-11-25T19:33:56.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
55622024-11-25T19:33:56.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55632024-11-25T19:33:56.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55642024-11-25T19:33:56.228ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
55652024-11-25T19:33:56.228ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.861838ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
55662024-11-25T19:33:56.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55672024-11-25T19:33:56.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55682024-11-25T19:33:56.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.073167ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55692024-11-25T19:33:57.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1397 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 03a325e9-0ea5-4035-9466-5f6f94955a91 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
55702024-11-25T19:33:58.540ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:53567
55712024-11-25T19:33:58.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53567 req_id = 2853874c-779a-4dd9-b164-e422afb44217 roles = RoleSet { roles: {} } uri = /metrics/producers
55722024-11-25T19:33:58.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53567 req_id = 2853874c-779a-4dd9-b164-e422afb44217 resource = Database result = Ok(()) uri = /metrics/producers
55732024-11-25T19:33:58.578ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 38711855-ef69-4d79-bb75-aebd85b1280b
55742024-11-25T19:33:58.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37655 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53567 req_id = 2853874c-779a-4dd9-b164-e422afb44217 response_code = 201 uri = /metrics/producers
55752024-11-25T19:34:05.032ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
55762024-11-25T19:34:05.032ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
55772024-11-25T19:34:05.063ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
55782024-11-25T19:34:05.063ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:36469
55792024-11-25T19:34:05.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36469 req_id = 0553af99-ab6b-4bf3-ba41-dddab49048df roles = RoleSet { roles: {} } uri = /metrics/producers
55802024-11-25T19:34:05.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36469 req_id = 0553af99-ab6b-4bf3-ba41-dddab49048df resource = Database result = Ok(()) uri = /metrics/producers
55812024-11-25T19:34:05.109ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
55822024-11-25T19:34:05.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45436 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36469 req_id = 0553af99-ab6b-4bf3-ba41-dddab49048df response_code = 201 uri = /metrics/producers
55832024-11-25T19:34:05.109ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "0553af99-ab6b-4bf3-ba41-dddab49048df", "content-length": "41", "date": "Mon, 25 Nov 2024 19:34:05 GMT"} })
55842024-11-25T19:34:05.109ZDEBGnexus (producer-registration-task): registered with nexus successfully
55852024-11-25T19:34:05.109ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
55862024-11-25T19:34:06.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
55872024-11-25T19:34:06.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
55882024-11-25T19:34:06.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55892024-11-25T19:34:06.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55902024-11-25T19:34:06.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55912024-11-25T19:34:06.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55922024-11-25T19:34:06.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55932024-11-25T19:34:06.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55942024-11-25T19:34:06.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55952024-11-25T19:34:06.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55962024-11-25T19:34:06.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55972024-11-25T19:34:06.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55982024-11-25T19:34:06.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55992024-11-25T19:34:06.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
56002024-11-25T19:34:06.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56012024-11-25T19:34:06.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56022024-11-25T19:34:06.223ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
56032024-11-25T19:34:06.223ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.194206ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
56042024-11-25T19:34:06.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56052024-11-25T19:34:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56062024-11-25T19:34:06.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.889246ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56072024-11-25T19:34:07.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1469 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 24949e47-5a89-4210-8d89-292bde8c3a9a response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
56082024-11-25T19:34:07.582ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63207
56092024-11-25T19:34:07.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63207 req_id = 2edffdb3-d92e-486c-9c9f-f300319d1c90 roles = RoleSet { roles: {} } uri = /metrics/producers
56102024-11-25T19:34:07.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63207 req_id = 2edffdb3-d92e-486c-9c9f-f300319d1c90 resource = Database result = Ok(()) uri = /metrics/producers
56112024-11-25T19:34:07.619ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b2b2b805-c910-42f7-8bd4-d5f05a06bed3
56122024-11-25T19:34:07.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37092 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63207 req_id = 2edffdb3-d92e-486c-9c9f-f300319d1c90 response_code = 201 uri = /metrics/producers
56132024-11-25T19:34:13.110ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:34274
56142024-11-25T19:34:13.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34274 req_id = 58f6d365-5e30-4260-9697-c2d0a363093d roles = RoleSet { roles: {} } uri = /metrics/producers
56152024-11-25T19:34:13.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34274 req_id = 58f6d365-5e30-4260-9697-c2d0a363093d resource = Database result = Ok(()) uri = /metrics/producers
56162024-11-25T19:34:13.154ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b59496f2-fc6d-46cb-9cf5-9b1a2e24358f
56172024-11-25T19:34:13.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44177 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34274 req_id = 58f6d365-5e30-4260-9697-c2d0a363093d response_code = 201 uri = /metrics/producers
56182024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
56192024-11-25T19:34:16.202ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56202024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
56212024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56222024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56232024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
56242024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56252024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56262024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
56272024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
56282024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56292024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
56302024-11-25T19:34:16.202ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
56312024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
56322024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.13\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
56332024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56342024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
56352024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
56362024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
56372024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56382024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
56392024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
56402024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
56412024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
56422024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
56432024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56442024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56452024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
56462024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
56472024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56482024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
56492024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
56502024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
56512024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56522024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
56532024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56542024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
56552024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
56562024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56572024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
56582024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56592024-11-25T19:34:16.202ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
56602024-11-25T19:34:16.202ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:24:16.202884851 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
56612024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
56622024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
56632024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
56642024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
56652024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56662024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
56672024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
56682024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56692024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
56702024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
56712024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
56722024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56732024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
56742024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
56752024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
56762024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
56772024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56782024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
56792024-11-25T19:34:16.203ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
56802024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
56812024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
56822024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56832024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56842024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56852024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56862024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
56872024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56882024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56892024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56902024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56912024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56922024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
56932024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56942024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56952024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56962024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56972024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
56982024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56992024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57002024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
57012024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57022024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57032024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57042024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57052024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57062024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57072024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57082024-11-25T19:34:16.203ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1281, tv_nsec: 750166424 } })
57092024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57102024-11-25T19:34:16.203ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57112024-11-25T19:34:16.203ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1281, tv_nsec: 750332477 } })
57122024-11-25T19:34:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57132024-11-25T19:34:16.204ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57142024-11-25T19:34:16.204ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
57152024-11-25T19:34:16.204ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.078601ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
57162024-11-25T19:34:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57172024-11-25T19:34:16.204ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57182024-11-25T19:34:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57192024-11-25T19:34:16.204ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
57202024-11-25T19:34:16.204ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.396928ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
57212024-11-25T19:34:16.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57222024-11-25T19:34:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57232024-11-25T19:34:16.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57242024-11-25T19:34:16.206ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57252024-11-25T19:34:16.206ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57262024-11-25T19:34:16.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57272024-11-25T19:34:16.206ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57282024-11-25T19:34:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57292024-11-25T19:34:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.883836ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57302024-11-25T19:34:16.207ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57312024-11-25T19:34:16.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57322024-11-25T19:34:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57332024-11-25T19:34:16.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57342024-11-25T19:34:16.208ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57352024-11-25T19:34:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57362024-11-25T19:34:16.209ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57372024-11-25T19:34:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57382024-11-25T19:34:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57392024-11-25T19:34:16.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57402024-11-25T19:34:16.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57412024-11-25T19:34:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57422024-11-25T19:34:16.211ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57432024-11-25T19:34:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57442024-11-25T19:34:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57452024-11-25T19:34:16.211ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.613179ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
57462024-11-25T19:34:16.212ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57472024-11-25T19:34:16.212ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57482024-11-25T19:34:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57492024-11-25T19:34:16.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57502024-11-25T19:34:16.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57512024-11-25T19:34:16.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57522024-11-25T19:34:16.214ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:24:16.202884851 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
57532024-11-25T19:34:16.214ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.859903ms iteration = 4 status = {"expiration":"2024-11-25T19:24:16.202884851Z","pruned":[]}
57542024-11-25T19:34:16.215ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1281, tv_nsec: 761519507 } })
57552024-11-25T19:34:16.215ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
57562024-11-25T19:34:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57572024-11-25T19:34:16.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57582024-11-25T19:34:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57592024-11-25T19:34:16.216ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57602024-11-25T19:34:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57612024-11-25T19:34:16.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57622024-11-25T19:34:16.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57632024-11-25T19:34:16.217ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57642024-11-25T19:34:16.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1281, tv_nsec: 764641428 } })
57652024-11-25T19:34:16.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.491243ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
57662024-11-25T19:34:16.218ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
57672024-11-25T19:34:16.218ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57682024-11-25T19:34:16.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
57692024-11-25T19:34:16.219ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57702024-11-25T19:34:16.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57712024-11-25T19:34:16.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
57722024-11-25T19:34:16.222ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57732024-11-25T19:34:16.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57742024-11-25T19:34:16.222ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57752024-11-25T19:34:16.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57762024-11-25T19:34:16.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
57772024-11-25T19:34:16.224ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57782024-11-25T19:34:16.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57792024-11-25T19:34:16.225ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57802024-11-25T19:34:16.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57812024-11-25T19:34:16.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57822024-11-25T19:34:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
57832024-11-25T19:34:16.227ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57842024-11-25T19:34:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57852024-11-25T19:34:16.228ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57862024-11-25T19:34:16.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57872024-11-25T19:34:16.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57882024-11-25T19:34:16.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57892024-11-25T19:34:16.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57902024-11-25T19:34:16.235ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57912024-11-25T19:34:16.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57922024-11-25T19:34:16.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57932024-11-25T19:34:16.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57942024-11-25T19:34:16.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.049938ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57952024-11-25T19:34:16.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57962024-11-25T19:34:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57972024-11-25T19:34:16.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57982024-11-25T19:34:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57992024-11-25T19:34:16.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.035754ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
58002024-11-25T19:34:16.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58012024-11-25T19:34:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
58022024-11-25T19:34:16.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58032024-11-25T19:34:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58042024-11-25T19:34:16.255ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58052024-11-25T19:34:16.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58062024-11-25T19:34:16.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58072024-11-25T19:34:16.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58082024-11-25T19:34:16.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58092024-11-25T19:34:16.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58102024-11-25T19:34:16.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58112024-11-25T19:34:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58122024-11-25T19:34:16.265ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58132024-11-25T19:34:16.265ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58142024-11-25T19:34:16.265ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58152024-11-25T19:34:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58162024-11-25T19:34:16.266ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58172024-11-25T19:34:16.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58182024-11-25T19:34:16.266ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58192024-11-25T19:34:16.267ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
58202024-11-25T19:34:16.267ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
58212024-11-25T19:34:16.267ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.948925ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
58222024-11-25T19:34:16.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58232024-11-25T19:34:16.268ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58242024-11-25T19:34:16.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58252024-11-25T19:34:16.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58262024-11-25T19:34:16.273ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58272024-11-25T19:34:16.273ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
58282024-11-25T19:34:16.273ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
58292024-11-25T19:34:16.273ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
58302024-11-25T19:34:16.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58312024-11-25T19:34:16.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58322024-11-25T19:34:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58332024-11-25T19:34:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58342024-11-25T19:34:16.275ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58352024-11-25T19:34:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58362024-11-25T19:34:16.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.522422ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
58372024-11-25T19:34:16.279ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
58382024-11-25T19:34:16.279ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
58392024-11-25T19:34:16.279ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.760676ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
58402024-11-25T19:34:16.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58412024-11-25T19:34:16.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58422024-11-25T19:34:16.283ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58432024-11-25T19:34:16.283ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.211444ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58442024-11-25T19:34:16.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58452024-11-25T19:34:16.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
58462024-11-25T19:34:16.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58472024-11-25T19:34:16.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58482024-11-25T19:34:16.303ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
58492024-11-25T19:34:16.303ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
58502024-11-25T19:34:16.303ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
58512024-11-25T19:34:16.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58522024-11-25T19:34:16.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58532024-11-25T19:34:16.336ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
58542024-11-25T19:34:16.355ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
58552024-11-25T19:34:16.355ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58562024-11-25T19:34:16.356ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0d0f23d-e945-46e1-9206-da538944851d", "content-length": "26", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
58572024-11-25T19:34:16.356ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58582024-11-25T19:34:16.358ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58592024-11-25T19:34:16.366ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
58602024-11-25T19:34:16.366ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58612024-11-25T19:34:16.366ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "82d2a199-cb69-401d-85b4-17d0c98486b3", "content-length": "26", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
58622024-11-25T19:34:16.366ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58632024-11-25T19:34:16.369ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58642024-11-25T19:34:16.414ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
58652024-11-25T19:34:16.492ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
58662024-11-25T19:34:16.501ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 298.483146ms iteration = 7 status = {}
58672024-11-25T19:34:16.504ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
58682024-11-25T19:34:16.504ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58692024-11-25T19:34:16.504ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "77ecf445-77ea-44f7-a006-bb2142fec692", "content-length": "372", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
58702024-11-25T19:34:16.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58712024-11-25T19:34:16.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58722024-11-25T19:34:16.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58732024-11-25T19:34:16.508ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1282, tv_nsec: 55328651 } })
58742024-11-25T19:34:16.509ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
58752024-11-25T19:34:16.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58762024-11-25T19:34:16.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58772024-11-25T19:34:16.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58782024-11-25T19:34:16.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58792024-11-25T19:34:16.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58802024-11-25T19:34:16.513ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 310.38768ms iteration = 3 status = {"nsuccess":5}
58812024-11-25T19:34:16.514ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58822024-11-25T19:34:16.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58832024-11-25T19:34:16.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58842024-11-25T19:34:16.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58852024-11-25T19:34:16.523ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58862024-11-25T19:34:16.524ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "49af18c2-d84b-4395-a344-048ace430c3b", "content-length": "1", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
58872024-11-25T19:34:16.525ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58882024-11-25T19:34:16.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58892024-11-25T19:34:16.527ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 324.942996ms iteration = 7 status = null
58902024-11-25T19:34:16.529ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
58912024-11-25T19:34:16.529ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 326.399264ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
58922024-11-25T19:34:16.535ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58932024-11-25T19:34:16.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58942024-11-25T19:34:16.536ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58952024-11-25T19:34:16.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58962024-11-25T19:34:16.538ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58972024-11-25T19:34:16.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58982024-11-25T19:34:16.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 346.460447ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58992024-11-25T19:34:16.551ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59002024-11-25T19:34:16.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59012024-11-25T19:34:16.552ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59022024-11-25T19:34:16.552ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59032024-11-25T19:34:16.552ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 349.473477ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59042024-11-25T19:34:16.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59052024-11-25T19:34:16.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59062024-11-25T19:34:16.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59072024-11-25T19:34:16.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59082024-11-25T19:34:16.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59092024-11-25T19:34:16.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
59102024-11-25T19:34:16.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59112024-11-25T19:34:16.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59122024-11-25T19:34:16.569ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 366.697344ms iteration = 7 status = 0
59132024-11-25T19:34:16.573ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
59142024-11-25T19:34:16.574ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59152024-11-25T19:34:16.574ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e5a545cb-567a-440e-a340-0ab021984f49", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
59162024-11-25T19:34:16.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59172024-11-25T19:34:16.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59182024-11-25T19:34:16.576ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
59192024-11-25T19:34:16.576ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
59202024-11-25T19:34:16.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59212024-11-25T19:34:16.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59222024-11-25T19:34:16.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59232024-11-25T19:34:16.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59242024-11-25T19:34:16.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59252024-11-25T19:34:16.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59262024-11-25T19:34:16.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59272024-11-25T19:34:16.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59282024-11-25T19:34:16.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59292024-11-25T19:34:16.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59302024-11-25T19:34:16.585ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
59312024-11-25T19:34:16.585ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 382.341702ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
59322024-11-25T19:34:16.588ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59332024-11-25T19:34:16.588ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59342024-11-25T19:34:16.588ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c22f3454-ceb8-469b-b2e8-823a6a7bc2b3", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
59352024-11-25T19:34:16.589ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 387.270948ms iteration = 8 status = {}
59362024-11-25T19:34:16.590ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
59372024-11-25T19:34:16.590ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
59382024-11-25T19:34:16.590ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
59392024-11-25T19:34:16.590ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 387.738957ms iteration = 5 status = {"generation":1}
59402024-11-25T19:34:16.592ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
59412024-11-25T19:34:16.592ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "21140ffc-f915-43eb-b369-a5e363767a34", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59422024-11-25T19:34:16.592ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59432024-11-25T19:34:16.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 389.796518ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59442024-11-25T19:34:16.594ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cf59ef4c-2bfb-4401-8066-8e5b34d23083", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59452024-11-25T19:34:16.594ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59462024-11-25T19:34:16.596ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59472024-11-25T19:34:16.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 393.820847ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
59482024-11-25T19:34:16.599ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
59492024-11-25T19:34:16.600ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "21dc5734-e4ab-49b9-9900-0bdb45c8a808", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
59502024-11-25T19:34:16.600ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
59512024-11-25T19:34:16.600ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
59522024-11-25T19:34:16.600ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
59532024-11-25T19:34:16.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59542024-11-25T19:34:16.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59552024-11-25T19:34:16.601ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "50a07b18-0c0c-4921-8b10-f52a0739401f", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
59562024-11-25T19:34:16.601ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
59572024-11-25T19:34:16.602ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5c0feca4-fd5e-4b8a-ab46-d99d6f1b87cf", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
59582024-11-25T19:34:16.602ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
59592024-11-25T19:34:16.604ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
59602024-11-25T19:34:16.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 401.627569ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
59612024-11-25T19:34:16.606ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
59622024-11-25T19:34:16.606ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59632024-11-25T19:34:16.607ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaf55967-eac0-4b30-ac81-f44b4c52436a", "content-length": "26", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
59642024-11-25T19:34:16.607ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59652024-11-25T19:34:16.608ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
59662024-11-25T19:34:16.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59672024-11-25T19:34:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59682024-11-25T19:34:16.620ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59692024-11-25T19:34:16.621ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
59702024-11-25T19:34:16.621ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 418.372199ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
59712024-11-25T19:34:16.621ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 418.813127ms iteration = 9 status = {"physical_disks_added":0}
59722024-11-25T19:34:16.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59732024-11-25T19:34:16.622ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59742024-11-25T19:34:16.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59752024-11-25T19:34:16.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59762024-11-25T19:34:16.625ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59772024-11-25T19:34:16.625ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59782024-11-25T19:34:16.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59792024-11-25T19:34:16.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59802024-11-25T19:34:16.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59812024-11-25T19:34:16.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59822024-11-25T19:34:16.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59832024-11-25T19:34:16.633ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
59842024-11-25T19:34:16.633ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
59852024-11-25T19:34:16.633ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
59862024-11-25T19:34:16.633ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 430.868754ms iteration = 5 status = {"generation":2}
59872024-11-25T19:34:16.689ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59882024-11-25T19:34:16.690ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7e94e6e-b674-4719-b03d-60b26dbed7ca", "content-length": "691", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
59892024-11-25T19:34:16.690ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59902024-11-25T19:34:16.690ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59912024-11-25T19:34:16.690ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59922024-11-25T19:34:16.691ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 488.089397ms iteration = 7 status = {}
59932024-11-25T19:34:16.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59942024-11-25T19:34:16.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59952024-11-25T19:34:16.734ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
59962024-11-25T19:34:16.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59972024-11-25T19:34:16.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59982024-11-25T19:34:16.740ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59992024-11-25T19:34:16.740ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1b6f332-c633-4230-a4b8-d6866c909bc0", "content-length": "134", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
60002024-11-25T19:34:16.740ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60012024-11-25T19:34:16.740ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
60022024-11-25T19:34:16.740ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60032024-11-25T19:34:16.740ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60042024-11-25T19:34:16.740ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60052024-11-25T19:34:16.740ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60062024-11-25T19:34:16.740ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60072024-11-25T19:34:16.740ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60082024-11-25T19:34:16.741ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60092024-11-25T19:34:16.741ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60102024-11-25T19:34:16.741ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
60112024-11-25T19:34:16.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60122024-11-25T19:34:16.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60132024-11-25T19:34:16.743ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60142024-11-25T19:34:16.743ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1d94940-cb65-4fbd-a534-0df2d8f1e660", "content-length": "2", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
60152024-11-25T19:34:16.743ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60162024-11-25T19:34:16.743ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "87f76ad7-f2dd-43cc-91ea-9e27d93b048e", "content-length": "51", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
60172024-11-25T19:34:16.743ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
60182024-11-25T19:34:16.743ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60192024-11-25T19:34:16.834ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2f5244b5-8579-452b-b4a1-8bd4149385ff", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
60202024-11-25T19:34:16.834ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
60212024-11-25T19:34:16.834ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60222024-11-25T19:34:16.835ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b98c2e0-e64b-4758-af22-8ba09ce01449", "content-length": "682", "date": "Mon, 25 Nov 2024 19:34:16 GMT"} })
60232024-11-25T19:34:16.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60242024-11-25T19:34:16.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60252024-11-25T19:34:16.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60262024-11-25T19:34:16.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60272024-11-25T19:34:16.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60282024-11-25T19:34:16.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60292024-11-25T19:34:16.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60302024-11-25T19:34:16.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60312024-11-25T19:34:16.851ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 648.82337ms iteration = 7 status = {}
60322024-11-25T19:34:17.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1527 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = f1b2b086-9bd7-43a7-b256-61e30b856bf1 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
60332024-11-25T19:34:26.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
60342024-11-25T19:34:26.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
60352024-11-25T19:34:26.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60362024-11-25T19:34:26.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60372024-11-25T19:34:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60382024-11-25T19:34:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60392024-11-25T19:34:26.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60402024-11-25T19:34:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60412024-11-25T19:34:26.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60422024-11-25T19:34:26.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60432024-11-25T19:34:26.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60442024-11-25T19:34:26.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60452024-11-25T19:34:26.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60462024-11-25T19:34:26.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
60472024-11-25T19:34:26.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60482024-11-25T19:34:26.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60492024-11-25T19:34:26.224ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
60502024-11-25T19:34:26.224ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.311538ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
60512024-11-25T19:34:26.232ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60522024-11-25T19:34:26.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60532024-11-25T19:34:26.259ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.872626ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60542024-11-25T19:34:27.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1450 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 834736d7-feb4-49bb-90c9-a1e0d157d98c response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
60552024-11-25T19:34:36.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
60562024-11-25T19:34:36.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
60572024-11-25T19:34:36.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60582024-11-25T19:34:36.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60592024-11-25T19:34:36.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60602024-11-25T19:34:36.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60612024-11-25T19:34:36.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60622024-11-25T19:34:36.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60632024-11-25T19:34:36.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60642024-11-25T19:34:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60652024-11-25T19:34:36.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60662024-11-25T19:34:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60672024-11-25T19:34:36.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60682024-11-25T19:34:36.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60692024-11-25T19:34:36.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60702024-11-25T19:34:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
60712024-11-25T19:34:36.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60722024-11-25T19:34:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60732024-11-25T19:34:36.224ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
60742024-11-25T19:34:36.224ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.233427ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
60752024-11-25T19:34:36.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.248423ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60762024-11-25T19:34:36.248ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53563
60772024-11-25T19:34:36.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53563 req_id = 951faa89-21ff-406d-9588-04628d6afca4 roles = RoleSet { roles: {} } uri = /metrics/producers
60782024-11-25T19:34:36.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53563 req_id = 951faa89-21ff-406d-9588-04628d6afca4 resource = Database result = Ok(()) uri = /metrics/producers
60792024-11-25T19:34:36.293ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = e1e4675c-73a5-46b5-9e0f-9d05cbba5670
60802024-11-25T19:34:36.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44782 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53563 req_id = 951faa89-21ff-406d-9588-04628d6afca4 response_code = 201 uri = /metrics/producers
60812024-11-25T19:34:37.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1247 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = bc6bba32-17ed-49d9-bff0-6e92b9b83444 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
60822024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
60832024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
60842024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60852024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
60862024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60872024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60882024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
60892024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60902024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60912024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
60922024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
60932024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60942024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
60952024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60962024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60972024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
60982024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
60992024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
61002024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61012024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
61022024-11-25T19:34:46.202ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61032024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61042024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
61052024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61062024-11-25T19:34:46.202ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
61072024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61082024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
61092024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
61102024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61112024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
61122024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
61132024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61142024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61152024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
61162024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61172024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61182024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61192024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61202024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61212024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61222024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61232024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61242024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61252024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61262024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61272024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61282024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61292024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61302024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61312024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61322024-11-25T19:34:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61332024-11-25T19:34:46.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61342024-11-25T19:34:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61352024-11-25T19:34:46.205ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.992819ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61362024-11-25T19:34:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61372024-11-25T19:34:46.206ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61382024-11-25T19:34:46.206ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61392024-11-25T19:34:46.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61402024-11-25T19:34:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61412024-11-25T19:34:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61422024-11-25T19:34:46.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61432024-11-25T19:34:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61442024-11-25T19:34:46.207ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1311, tv_nsec: 753934258 } })
61452024-11-25T19:34:46.208ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
61462024-11-25T19:34:46.208ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61472024-11-25T19:34:46.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61482024-11-25T19:34:46.209ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61492024-11-25T19:34:46.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1311, tv_nsec: 756602561 } })
61502024-11-25T19:34:46.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61512024-11-25T19:34:46.210ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61522024-11-25T19:34:46.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
61532024-11-25T19:34:46.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61542024-11-25T19:34:46.211ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61552024-11-25T19:34:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61562024-11-25T19:34:46.212ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61572024-11-25T19:34:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61582024-11-25T19:34:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61592024-11-25T19:34:46.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61602024-11-25T19:34:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61612024-11-25T19:34:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61622024-11-25T19:34:46.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61632024-11-25T19:34:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61642024-11-25T19:34:46.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61652024-11-25T19:34:46.216ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.391583ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61662024-11-25T19:34:46.217ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61672024-11-25T19:34:46.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61682024-11-25T19:34:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61692024-11-25T19:34:46.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1311, tv_nsec: 764200850 } })
61702024-11-25T19:34:46.218ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
61712024-11-25T19:34:46.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61722024-11-25T19:34:46.219ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61732024-11-25T19:34:46.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61742024-11-25T19:34:46.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61752024-11-25T19:34:46.220ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61762024-11-25T19:34:46.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61772024-11-25T19:34:46.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.75621ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
61782024-11-25T19:34:46.248ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61792024-11-25T19:34:46.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61802024-11-25T19:34:46.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 46.823519ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
61812024-11-25T19:34:46.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61822024-11-25T19:34:46.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61832024-11-25T19:34:46.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61842024-11-25T19:34:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61852024-11-25T19:34:46.255ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61862024-11-25T19:34:46.255ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61872024-11-25T19:34:46.255ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61882024-11-25T19:34:46.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61892024-11-25T19:34:46.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61902024-11-25T19:34:46.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61912024-11-25T19:34:46.258ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.168152ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
61922024-11-25T19:34:46.258ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61932024-11-25T19:34:46.258ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61942024-11-25T19:34:46.258ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 55.856056ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61952024-11-25T19:34:46.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61962024-11-25T19:34:46.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61972024-11-25T19:34:46.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61982024-11-25T19:34:46.260ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61992024-11-25T19:34:46.260ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 57.207263ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62002024-11-25T19:34:46.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62012024-11-25T19:34:46.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62022024-11-25T19:34:46.261ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62032024-11-25T19:34:46.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62042024-11-25T19:34:46.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62052024-11-25T19:34:46.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62062024-11-25T19:34:46.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62072024-11-25T19:34:46.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62082024-11-25T19:34:46.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62092024-11-25T19:34:46.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62102024-11-25T19:34:46.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62112024-11-25T19:34:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62122024-11-25T19:34:46.264ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.395825ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62132024-11-25T19:34:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
62142024-11-25T19:34:46.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62152024-11-25T19:34:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62162024-11-25T19:34:46.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62172024-11-25T19:34:46.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62182024-11-25T19:34:46.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62192024-11-25T19:34:46.272ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 69.170167ms iteration = 10 status = {"physical_disks_added":0}
62202024-11-25T19:34:46.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62212024-11-25T19:34:46.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62222024-11-25T19:34:46.273ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
62232024-11-25T19:34:46.273ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.583555ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
62242024-11-25T19:34:46.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62252024-11-25T19:34:46.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62262024-11-25T19:34:46.276ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62272024-11-25T19:34:46.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62282024-11-25T19:34:46.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62292024-11-25T19:34:46.281ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 78.615413ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
62302024-11-25T19:34:46.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62312024-11-25T19:34:46.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
62322024-11-25T19:34:46.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62332024-11-25T19:34:46.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62342024-11-25T19:34:46.291ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.562068ms iteration = 8 status = 0
62352024-11-25T19:34:46.308ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
62362024-11-25T19:34:46.308ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62372024-11-25T19:34:46.308ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "43b898f9-4f2e-4601-a024-2839a22ab909", "content-length": "26", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
62382024-11-25T19:34:46.308ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62392024-11-25T19:34:46.309ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62402024-11-25T19:34:46.377ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
62412024-11-25T19:34:46.377ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62422024-11-25T19:34:46.377ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a663c143-7e91-4f0e-92e8-771fef632fbd", "content-length": "26", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
62432024-11-25T19:34:46.377ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62442024-11-25T19:34:46.378ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62452024-11-25T19:34:46.418ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
62462024-11-25T19:34:46.418ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62472024-11-25T19:34:46.418ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62482024-11-25T19:34:46.418ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e979c06-e191-433d-9e39-f9eae8ec7cdb", "content-length": "26", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
62492024-11-25T19:34:46.418ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62502024-11-25T19:34:46.418ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2c6017c-0807-461a-81c9-ba485570cde3", "content-length": "691", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
62512024-11-25T19:34:46.418ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
62522024-11-25T19:34:46.418ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
62532024-11-25T19:34:46.418ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
62542024-11-25T19:34:46.423ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
62552024-11-25T19:34:46.423ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 220.777062ms iteration = 8 status = {}
62562024-11-25T19:34:46.447ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 245.034328ms iteration = 8 status = {}
62572024-11-25T19:34:46.448ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62582024-11-25T19:34:46.448ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62592024-11-25T19:34:46.448ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ec41eac-7c3b-498b-ab77-2ed06d600273", "content-length": "372", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
62602024-11-25T19:34:46.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62612024-11-25T19:34:46.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62622024-11-25T19:34:46.469ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62632024-11-25T19:34:46.469ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "46fbd37e-3d34-493c-875f-9b08c3c77c5e", "content-length": "1", "date": "Mon, 25 Nov 2024 19:34:45 GMT"} })
62642024-11-25T19:34:46.471ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62652024-11-25T19:34:46.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62662024-11-25T19:34:46.473ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 270.811093ms iteration = 8 status = null
62672024-11-25T19:34:46.487ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
62682024-11-25T19:34:46.487ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62692024-11-25T19:34:46.487ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "63f0d644-25e7-421e-a652-147e8962054f", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
62702024-11-25T19:34:46.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62712024-11-25T19:34:46.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62722024-11-25T19:34:46.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62732024-11-25T19:34:46.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62742024-11-25T19:34:46.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62752024-11-25T19:34:46.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62762024-11-25T19:34:46.497ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62772024-11-25T19:34:46.497ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62782024-11-25T19:34:46.497ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "af1d60ae-7a45-4c35-9db3-2d01869b0263", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
62792024-11-25T19:34:46.499ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.800514ms iteration = 9 status = {}
62802024-11-25T19:34:46.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62812024-11-25T19:34:46.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62822024-11-25T19:34:46.543ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
62832024-11-25T19:34:46.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62842024-11-25T19:34:46.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62852024-11-25T19:34:46.551ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
62862024-11-25T19:34:46.551ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b94c8b0b-5438-426f-8483-8b7328c57e71", "content-length": "134", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
62872024-11-25T19:34:46.551ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
62882024-11-25T19:34:46.551ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
62892024-11-25T19:34:46.552ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
62902024-11-25T19:34:46.552ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
62912024-11-25T19:34:46.552ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62922024-11-25T19:34:46.552ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62932024-11-25T19:34:46.552ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62942024-11-25T19:34:46.552ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62952024-11-25T19:34:46.552ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62962024-11-25T19:34:46.552ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62972024-11-25T19:34:46.552ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
62982024-11-25T19:34:46.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62992024-11-25T19:34:46.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63002024-11-25T19:34:46.555ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63012024-11-25T19:34:46.555ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c339aaf3-aa7a-45f7-a5b1-7dd99688853e", "content-length": "2", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
63022024-11-25T19:34:46.555ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63032024-11-25T19:34:46.555ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3db4bbd4-647a-4080-971a-770940291456", "content-length": "51", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
63042024-11-25T19:34:46.555ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
63052024-11-25T19:34:46.555ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63062024-11-25T19:34:46.647ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ed7a77f7-f44f-412e-873b-80d56e4e1b04", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
63072024-11-25T19:34:46.647ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
63082024-11-25T19:34:46.647ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63092024-11-25T19:34:46.647ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ed92e78-5593-416e-b786-829628356f14", "content-length": "682", "date": "Mon, 25 Nov 2024 19:34:46 GMT"} })
63102024-11-25T19:34:46.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63112024-11-25T19:34:46.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63122024-11-25T19:34:46.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63132024-11-25T19:34:46.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63142024-11-25T19:34:46.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63152024-11-25T19:34:46.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63162024-11-25T19:34:46.657ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63172024-11-25T19:34:46.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63182024-11-25T19:34:46.665ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 462.311131ms iteration = 8 status = {}
63192024-11-25T19:34:47.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1177 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 3ee85290-b8ff-401a-99cc-55d28a3e4be5 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
63202024-11-25T19:34:47.697ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45089
63212024-11-25T19:34:47.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45089 req_id = fb6c032a-1699-4c84-8594-a1e1a29d74f6 roles = RoleSet { roles: {} } uri = /metrics/producers
63222024-11-25T19:34:47.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45089 req_id = fb6c032a-1699-4c84-8594-a1e1a29d74f6 resource = Database result = Ok(()) uri = /metrics/producers
63232024-11-25T19:34:47.707ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = d2d29ac8-9dfa-4f1f-be62-a88a71a6b2fa
63242024-11-25T19:34:47.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10363 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45089 req_id = fb6c032a-1699-4c84-8594-a1e1a29d74f6 response_code = 201 uri = /metrics/producers
63252024-11-25T19:34:52.277ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:34460
63262024-11-25T19:34:52.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 5d2e94e5-4d39-49b1-b19c-d2974353bc8c roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
63272024-11-25T19:34:52.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 5d2e94e5-4d39-49b1-b19c-d2974353bc8c resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
63282024-11-25T19:34:52.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 5d2e94e5-4d39-49b1-b19c-d2974353bc8c response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
63292024-11-25T19:34:52.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 706a6576-a0f8-4a6d-8183-6b8f7ad64776 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
63302024-11-25T19:34:52.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 706a6576-a0f8-4a6d-8183-6b8f7ad64776 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
63312024-11-25T19:34:52.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 706a6576-a0f8-4a6d-8183-6b8f7ad64776 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
63322024-11-25T19:34:53.580ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35349
63332024-11-25T19:34:53.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35349 req_id = cfc6a51d-6ad4-42f8-81a6-b8282f45329b roles = RoleSet { roles: {} } uri = /metrics/producers
63342024-11-25T19:34:53.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35349 req_id = cfc6a51d-6ad4-42f8-81a6-b8282f45329b resource = Database result = Ok(()) uri = /metrics/producers
63352024-11-25T19:34:53.626ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 4626c149-3efd-47ab-bfa7-bdd3e9545fef
63362024-11-25T19:34:53.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45868 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35349 req_id = cfc6a51d-6ad4-42f8-81a6-b8282f45329b response_code = 201 uri = /metrics/producers
63372024-11-25T19:34:56.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
63382024-11-25T19:34:56.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63392024-11-25T19:34:56.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
63402024-11-25T19:34:56.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63412024-11-25T19:34:56.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63422024-11-25T19:34:56.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63432024-11-25T19:34:56.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63442024-11-25T19:34:56.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63452024-11-25T19:34:56.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63462024-11-25T19:34:56.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63472024-11-25T19:34:56.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63482024-11-25T19:34:56.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63492024-11-25T19:34:56.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.816565ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63502024-11-25T19:34:56.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63512024-11-25T19:34:56.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63522024-11-25T19:34:56.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63532024-11-25T19:34:56.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
63542024-11-25T19:34:56.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63552024-11-25T19:34:56.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63562024-11-25T19:34:56.220ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
63572024-11-25T19:34:56.220ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.705767ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
63582024-11-25T19:34:57.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1659 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 3d7381d7-34af-4e32-b140-8da8bab1b988 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
63592024-11-25T19:35:06.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
63602024-11-25T19:35:06.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63612024-11-25T19:35:06.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
63622024-11-25T19:35:06.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63632024-11-25T19:35:06.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63642024-11-25T19:35:06.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63652024-11-25T19:35:06.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63662024-11-25T19:35:06.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63672024-11-25T19:35:06.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63682024-11-25T19:35:06.208ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.392386ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63692024-11-25T19:35:06.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63702024-11-25T19:35:06.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63712024-11-25T19:35:06.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63722024-11-25T19:35:06.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63732024-11-25T19:35:06.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63742024-11-25T19:35:06.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63752024-11-25T19:35:06.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
63762024-11-25T19:35:06.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63772024-11-25T19:35:06.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63782024-11-25T19:35:06.226ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
63792024-11-25T19:35:06.226ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.310518ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
63802024-11-25T19:35:07.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1161 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 812a1a1e-d366-4c4f-991e-1b215de5018a response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
63812024-11-25T19:35:16.203ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
63822024-11-25T19:35:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
63832024-11-25T19:35:16.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63842024-11-25T19:35:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
63852024-11-25T19:35:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
63862024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
63872024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63882024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
63892024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
63902024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
63912024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
63922024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63932024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
63942024-11-25T19:35:16.204ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
63952024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.141\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
63962024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
63972024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
63982024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
63992024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
64002024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64012024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64022024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64032024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
64042024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
64052024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
64062024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
64072024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64082024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
64092024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64102024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
64112024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
64122024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64132024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64142024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
64152024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
64162024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
64172024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64182024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
64192024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
64202024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
64212024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64222024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64232024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
64242024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
64252024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64262024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
64272024-11-25T19:35:16.204ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
64282024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
64292024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
64302024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64312024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
64322024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64332024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
64342024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64352024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
64362024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64372024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
64382024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
64392024-11-25T19:35:16.204ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:25:16.204316577 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
64402024-11-25T19:35:16.204ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64412024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
64422024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64432024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
64442024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64452024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64462024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64472024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64482024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64492024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
64502024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64512024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64522024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64532024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64542024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
64552024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64562024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64572024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
64582024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
64592024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64602024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64612024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64622024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64632024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64642024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
64652024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64662024-11-25T19:35:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64672024-11-25T19:35:16.204ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1341, tv_nsec: 749750536 } })
64682024-11-25T19:35:16.204ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1341, tv_nsec: 749777107 } })
64692024-11-25T19:35:16.205ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
64702024-11-25T19:35:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.437318ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
64712024-11-25T19:35:16.205ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
64722024-11-25T19:35:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.497429ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
64732024-11-25T19:35:16.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64742024-11-25T19:35:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.734004ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
64752024-11-25T19:35:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.876356ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64762024-11-25T19:35:16.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64772024-11-25T19:35:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64782024-11-25T19:35:16.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64792024-11-25T19:35:16.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.991309ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
64802024-11-25T19:35:16.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64812024-11-25T19:35:16.208ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64822024-11-25T19:35:16.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64832024-11-25T19:35:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64842024-11-25T19:35:16.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64852024-11-25T19:35:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64862024-11-25T19:35:16.211ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64872024-11-25T19:35:16.211ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
64882024-11-25T19:35:16.211ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64892024-11-25T19:35:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64902024-11-25T19:35:16.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64912024-11-25T19:35:16.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64922024-11-25T19:35:16.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64932024-11-25T19:35:16.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64942024-11-25T19:35:16.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64952024-11-25T19:35:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64962024-11-25T19:35:16.216ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1341, tv_nsec: 761718671 } })
64972024-11-25T19:35:16.217ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
64982024-11-25T19:35:16.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64992024-11-25T19:35:16.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65002024-11-25T19:35:16.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65012024-11-25T19:35:16.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65022024-11-25T19:35:16.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65032024-11-25T19:35:16.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65042024-11-25T19:35:16.225ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:25:16.204316577 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
65052024-11-25T19:35:16.225ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.830899ms iteration = 5 status = {"expiration":"2024-11-25T19:25:16.204316577Z","pruned":[]}
65062024-11-25T19:35:16.227ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65072024-11-25T19:35:16.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65082024-11-25T19:35:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65092024-11-25T19:35:16.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65102024-11-25T19:35:16.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65112024-11-25T19:35:16.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65122024-11-25T19:35:16.230ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1341, tv_nsec: 775596963 } })
65132024-11-25T19:35:16.231ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
65142024-11-25T19:35:16.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65152024-11-25T19:35:16.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65162024-11-25T19:35:16.233ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1341, tv_nsec: 777836427 } })
65172024-11-25T19:35:16.233ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
65182024-11-25T19:35:16.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65192024-11-25T19:35:16.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65202024-11-25T19:35:16.236ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65212024-11-25T19:35:16.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65222024-11-25T19:35:16.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65232024-11-25T19:35:16.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65242024-11-25T19:35:16.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65252024-11-25T19:35:16.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65262024-11-25T19:35:16.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65272024-11-25T19:35:16.238ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65282024-11-25T19:35:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65292024-11-25T19:35:16.239ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
65302024-11-25T19:35:16.239ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
65312024-11-25T19:35:16.239ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
65322024-11-25T19:35:16.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65332024-11-25T19:35:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65342024-11-25T19:35:16.239ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65352024-11-25T19:35:16.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65362024-11-25T19:35:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65372024-11-25T19:35:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
65382024-11-25T19:35:16.242ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65392024-11-25T19:35:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65402024-11-25T19:35:16.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
65412024-11-25T19:35:16.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65422024-11-25T19:35:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65432024-11-25T19:35:16.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65442024-11-25T19:35:16.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65452024-11-25T19:35:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65462024-11-25T19:35:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65472024-11-25T19:35:16.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65482024-11-25T19:35:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65492024-11-25T19:35:16.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65502024-11-25T19:35:16.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65512024-11-25T19:35:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65522024-11-25T19:35:16.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65532024-11-25T19:35:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65542024-11-25T19:35:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65552024-11-25T19:35:16.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.074203ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65562024-11-25T19:35:16.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.800967ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
65572024-11-25T19:35:16.257ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65582024-11-25T19:35:16.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65592024-11-25T19:35:16.259ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65602024-11-25T19:35:16.260ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
65612024-11-25T19:35:16.260ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
65622024-11-25T19:35:16.260ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.359706ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
65632024-11-25T19:35:16.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65642024-11-25T19:35:16.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65652024-11-25T19:35:16.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65662024-11-25T19:35:16.261ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65672024-11-25T19:35:16.262ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65682024-11-25T19:35:16.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65692024-11-25T19:35:16.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
65702024-11-25T19:35:16.263ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65712024-11-25T19:35:16.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65722024-11-25T19:35:16.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
65732024-11-25T19:35:16.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65742024-11-25T19:35:16.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.740812ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
65752024-11-25T19:35:16.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65762024-11-25T19:35:16.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65772024-11-25T19:35:16.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65782024-11-25T19:35:16.267ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65792024-11-25T19:35:16.267ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.69809ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65802024-11-25T19:35:16.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65812024-11-25T19:35:16.270ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65822024-11-25T19:35:16.270ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65832024-11-25T19:35:16.270ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65842024-11-25T19:35:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65852024-11-25T19:35:16.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
65862024-11-25T19:35:16.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65872024-11-25T19:35:16.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65882024-11-25T19:35:16.273ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.655187ms iteration = 9 status = 0
65892024-11-25T19:35:16.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65902024-11-25T19:35:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65912024-11-25T19:35:16.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65922024-11-25T19:35:16.282ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65932024-11-25T19:35:16.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65942024-11-25T19:35:16.286ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65952024-11-25T19:35:16.286ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65962024-11-25T19:35:16.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65972024-11-25T19:35:16.293ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
65982024-11-25T19:35:16.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65992024-11-25T19:35:16.296ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66002024-11-25T19:35:16.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66012024-11-25T19:35:16.297ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
66022024-11-25T19:35:16.297ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 93.066866ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
66032024-11-25T19:35:16.298ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 94.483464ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
66042024-11-25T19:35:16.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.460033ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66052024-11-25T19:35:16.301ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
66062024-11-25T19:35:16.301ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
66072024-11-25T19:35:16.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66082024-11-25T19:35:16.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66092024-11-25T19:35:16.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.187156ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
66102024-11-25T19:35:16.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66112024-11-25T19:35:16.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66122024-11-25T19:35:16.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66132024-11-25T19:35:16.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66142024-11-25T19:35:16.308ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
66152024-11-25T19:35:16.308ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
66162024-11-25T19:35:16.308ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
66172024-11-25T19:35:16.308ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 104.617812ms iteration = 6 status = {"generation":2}
66182024-11-25T19:35:16.311ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66192024-11-25T19:35:16.311ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66202024-11-25T19:35:16.311ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.171973ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66212024-11-25T19:35:16.314ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
66222024-11-25T19:35:16.314ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
66232024-11-25T19:35:16.314ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 110.254533ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
66242024-11-25T19:35:16.317ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
66252024-11-25T19:35:16.317ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
66262024-11-25T19:35:16.317ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
66272024-11-25T19:35:16.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66282024-11-25T19:35:16.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66292024-11-25T19:35:16.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66302024-11-25T19:35:16.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66312024-11-25T19:35:16.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66322024-11-25T19:35:16.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66332024-11-25T19:35:16.342ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
66342024-11-25T19:35:16.342ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 138.214802ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
66352024-11-25T19:35:16.345ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
66362024-11-25T19:35:16.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66372024-11-25T19:35:16.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66382024-11-25T19:35:16.353ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66392024-11-25T19:35:16.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66402024-11-25T19:35:16.354ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 150.721997ms iteration = 11 status = {"physical_disks_added":0}
66412024-11-25T19:35:16.355ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66422024-11-25T19:35:16.357ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
66432024-11-25T19:35:16.357ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
66442024-11-25T19:35:16.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66452024-11-25T19:35:16.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66462024-11-25T19:35:16.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66472024-11-25T19:35:16.357ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66482024-11-25T19:35:16.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66492024-11-25T19:35:16.358ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66502024-11-25T19:35:16.359ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66512024-11-25T19:35:16.361ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66522024-11-25T19:35:16.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66532024-11-25T19:35:16.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66542024-11-25T19:35:16.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66552024-11-25T19:35:16.361ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66562024-11-25T19:35:16.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66572024-11-25T19:35:16.364ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
66582024-11-25T19:35:16.364ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
66592024-11-25T19:35:16.364ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
66602024-11-25T19:35:16.364ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 160.309215ms iteration = 6 status = {"generation":1}
66612024-11-25T19:35:16.386ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
66622024-11-25T19:35:16.386ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66632024-11-25T19:35:16.387ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d64c144a-3e6e-44af-a443-480023616fdb", "content-length": "26", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
66642024-11-25T19:35:16.387ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66652024-11-25T19:35:16.389ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66662024-11-25T19:35:16.437ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
66672024-11-25T19:35:16.442ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
66682024-11-25T19:35:16.442ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66692024-11-25T19:35:16.442ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3f006ab-c10b-47ac-91a7-394f71ad345f", "content-length": "26", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
66702024-11-25T19:35:16.442ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66712024-11-25T19:35:16.444ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
66722024-11-25T19:35:16.536ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66732024-11-25T19:35:16.537ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "421dd764-d638-4f0c-b5cb-5b50baa89245", "content-length": "691", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
66742024-11-25T19:35:16.537ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
66752024-11-25T19:35:16.537ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
66762024-11-25T19:35:16.537ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
66772024-11-25T19:35:16.538ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 334.577104ms iteration = 9 status = {}
66782024-11-25T19:35:16.540ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
66792024-11-25T19:35:16.540ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66802024-11-25T19:35:16.540ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "384a66fa-858c-4863-a129-3a19b05eab4a", "content-length": "372", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
66812024-11-25T19:35:16.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66822024-11-25T19:35:16.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66832024-11-25T19:35:16.550ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
66842024-11-25T19:35:16.550ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66852024-11-25T19:35:16.550ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d66935c2-cae6-4528-b637-5db435aad005", "content-length": "26", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
66862024-11-25T19:35:16.550ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66872024-11-25T19:35:16.552ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66882024-11-25T19:35:16.579ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
66892024-11-25T19:35:16.579ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66902024-11-25T19:35:16.579ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f110d755-bd6e-409e-ae64-84172cf184cb", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
66912024-11-25T19:35:16.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66922024-11-25T19:35:16.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66932024-11-25T19:35:16.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66942024-11-25T19:35:16.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66952024-11-25T19:35:16.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66962024-11-25T19:35:16.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66972024-11-25T19:35:16.588ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66982024-11-25T19:35:16.588ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66992024-11-25T19:35:16.588ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "126c5ea1-4265-4333-acac-00f0207ae73c", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
67002024-11-25T19:35:16.590ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 386.277139ms iteration = 10 status = {}
67012024-11-25T19:35:16.633ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
67022024-11-25T19:35:16.644ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
67032024-11-25T19:35:16.645ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "190be859-b8b0-4446-a665-24c79b68d030", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67042024-11-25T19:35:16.645ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67052024-11-25T19:35:16.647ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "de73528f-d02d-4471-bda0-923dc8fd170a", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67062024-11-25T19:35:16.647ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67072024-11-25T19:35:16.649ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67082024-11-25T19:35:16.649ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 445.206215ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
67092024-11-25T19:35:16.662ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67102024-11-25T19:35:16.662ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "84a4ecf7-ba20-4325-952b-324769b22d04", "content-length": "1", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
67112024-11-25T19:35:16.664ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67122024-11-25T19:35:16.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67132024-11-25T19:35:16.666ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 462.606587ms iteration = 9 status = null
67142024-11-25T19:35:16.722ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 518.305269ms iteration = 9 status = {}
67152024-11-25T19:35:16.803ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
67162024-11-25T19:35:16.804ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ebbcd518-8cd4-41a3-a693-1bcc08bd8de9", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67172024-11-25T19:35:16.804ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67182024-11-25T19:35:16.805ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "88349836-43cc-47e2-a5f5-9483d118a124", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67192024-11-25T19:35:16.805ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67202024-11-25T19:35:16.806ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "322d65c9-3049-47e3-aade-d644f9688e96", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67212024-11-25T19:35:16.806ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67222024-11-25T19:35:16.808ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
67232024-11-25T19:35:16.808ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 603.999231ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
67242024-11-25T19:35:16.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67252024-11-25T19:35:16.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67262024-11-25T19:35:16.847ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
67272024-11-25T19:35:16.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67282024-11-25T19:35:16.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67292024-11-25T19:35:16.859ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
67302024-11-25T19:35:16.859ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c50bbc9b-21a2-478b-ba78-2dfb891c3a3c", "content-length": "134", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
67312024-11-25T19:35:16.859ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
67322024-11-25T19:35:16.859ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
67332024-11-25T19:35:16.860ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
67342024-11-25T19:35:16.860ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67352024-11-25T19:35:16.860ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67362024-11-25T19:35:16.860ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67372024-11-25T19:35:16.860ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67382024-11-25T19:35:16.860ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67392024-11-25T19:35:16.860ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67402024-11-25T19:35:16.860ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67412024-11-25T19:35:16.860ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
67422024-11-25T19:35:16.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67432024-11-25T19:35:16.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67442024-11-25T19:35:16.863ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67452024-11-25T19:35:16.863ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b70b64e4-e04d-45e4-a00c-206deedf7616", "content-length": "2", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
67462024-11-25T19:35:16.863ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67472024-11-25T19:35:16.863ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0da662f-9088-4ccb-874a-64abe9ee6092", "content-length": "51", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
67482024-11-25T19:35:16.863ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
67492024-11-25T19:35:16.863ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67502024-11-25T19:35:17.006ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "40ba972d-b1a5-4fdb-8244-e753edb9a9c5", "date": "Mon, 25 Nov 2024 19:35:16 GMT"} })
67512024-11-25T19:35:17.006ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
67522024-11-25T19:35:17.006ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67532024-11-25T19:35:17.007ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7c791dd-4860-4a21-937c-e7b22e221ce6", "content-length": "682", "date": "Mon, 25 Nov 2024 19:35:17 GMT"} })
67542024-11-25T19:35:17.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67552024-11-25T19:35:17.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67562024-11-25T19:35:17.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67572024-11-25T19:35:17.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67582024-11-25T19:35:17.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67592024-11-25T19:35:17.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67602024-11-25T19:35:17.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67612024-11-25T19:35:17.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67622024-11-25T19:35:17.026ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 822.549118ms iteration = 9 status = {}
67632024-11-25T19:35:17.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1488 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 359b7623-767e-40b1-bcdd-0e5cfeb40fc4 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
67642024-11-25T19:35:22.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 574bc3b4-6fae-405d-be16-3f399a941ee7 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
67652024-11-25T19:35:22.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 574bc3b4-6fae-405d-be16-3f399a941ee7 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
67662024-11-25T19:35:22.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 574bc3b4-6fae-405d-be16-3f399a941ee7 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
67672024-11-25T19:35:22.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = ea18601a-09d7-4ff5-86a4-c918f92a4acb roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
67682024-11-25T19:35:22.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = ea18601a-09d7-4ff5-86a4-c918f92a4acb resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
67692024-11-25T19:35:22.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = ea18601a-09d7-4ff5-86a4-c918f92a4acb response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
67702024-11-25T19:35:26.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
67712024-11-25T19:35:26.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
67722024-11-25T19:35:26.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67732024-11-25T19:35:26.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67742024-11-25T19:35:26.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67752024-11-25T19:35:26.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67762024-11-25T19:35:26.207ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67772024-11-25T19:35:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67782024-11-25T19:35:26.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67792024-11-25T19:35:26.209ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.60548ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67802024-11-25T19:35:26.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67812024-11-25T19:35:26.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67822024-11-25T19:35:26.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67832024-11-25T19:35:26.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67842024-11-25T19:35:26.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67852024-11-25T19:35:26.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67862024-11-25T19:35:26.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
67872024-11-25T19:35:26.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67882024-11-25T19:35:26.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67892024-11-25T19:35:26.228ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
67902024-11-25T19:35:26.228ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.190095ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
67912024-11-25T19:35:27.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1599 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 65d7c010-74c0-44bd-bb56-c51f0a26fa94 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
67922024-11-25T19:35:36.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
67932024-11-25T19:35:36.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
67942024-11-25T19:35:36.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67952024-11-25T19:35:36.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67962024-11-25T19:35:36.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67972024-11-25T19:35:36.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67982024-11-25T19:35:36.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67992024-11-25T19:35:36.207ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68002024-11-25T19:35:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68012024-11-25T19:35:36.209ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.013119ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68022024-11-25T19:35:36.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68032024-11-25T19:35:36.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68042024-11-25T19:35:36.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68052024-11-25T19:35:36.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68062024-11-25T19:35:36.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68072024-11-25T19:35:36.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68082024-11-25T19:35:36.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
68092024-11-25T19:35:36.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68102024-11-25T19:35:36.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68112024-11-25T19:35:36.225ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
68122024-11-25T19:35:36.225ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.88843ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
68132024-11-25T19:35:37.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = d74acdf4-7600-42d5-8c27-de3a8812f30b roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
68142024-11-25T19:35:37.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = d74acdf4-7600-42d5-8c27-de3a8812f30b resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
68152024-11-25T19:35:37.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = d74acdf4-7600-42d5-8c27-de3a8812f30b response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
68162024-11-25T19:35:37.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = efde293d-03b5-475c-8a20-22a8124c7d84 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
68172024-11-25T19:35:37.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = efde293d-03b5-475c-8a20-22a8124c7d84 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
68182024-11-25T19:35:37.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = efde293d-03b5-475c-8a20-22a8124c7d84 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
68192024-11-25T19:35:37.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1510 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 60a0c3c9-0760-497e-87ea-30c9bdffa1e8 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
68202024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
68212024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68222024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
68232024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
68242024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68252024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68262024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
68272024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
68282024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
68292024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68302024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68312024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
68322024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
68332024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68342024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68352024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
68362024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68372024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
68382024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68392024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
68402024-11-25T19:35:46.204ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
68412024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
68422024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68432024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68442024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
68452024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68462024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
68472024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68482024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
68492024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
68502024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
68512024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
68522024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
68532024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68542024-11-25T19:35:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
68552024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68562024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68572024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68582024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68592024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68602024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68612024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68622024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
68632024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68642024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68652024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
68662024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68672024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
68682024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68692024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68702024-11-25T19:35:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68712024-11-25T19:35:46.207ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1371, tv_nsec: 751703024 } })
68722024-11-25T19:35:46.207ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
68732024-11-25T19:35:46.208ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68742024-11-25T19:35:46.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68752024-11-25T19:35:46.208ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68762024-11-25T19:35:46.208ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.663472ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
68772024-11-25T19:35:46.208ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68782024-11-25T19:35:46.208ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68792024-11-25T19:35:46.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68802024-11-25T19:35:46.208ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68812024-11-25T19:35:46.208ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68822024-11-25T19:35:46.210ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68832024-11-25T19:35:46.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1371, tv_nsec: 754962768 } })
68842024-11-25T19:35:46.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
68852024-11-25T19:35:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
68862024-11-25T19:35:46.211ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68872024-11-25T19:35:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68882024-11-25T19:35:46.211ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68892024-11-25T19:35:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68902024-11-25T19:35:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68912024-11-25T19:35:46.212ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68922024-11-25T19:35:46.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68932024-11-25T19:35:46.213ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.389925ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
68942024-11-25T19:35:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68952024-11-25T19:35:46.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68962024-11-25T19:35:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68972024-11-25T19:35:46.213ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.679571ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
68982024-11-25T19:35:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
68992024-11-25T19:35:46.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69002024-11-25T19:35:46.215ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69012024-11-25T19:35:46.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69022024-11-25T19:35:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69032024-11-25T19:35:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69042024-11-25T19:35:46.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69052024-11-25T19:35:46.217ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.654798ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69062024-11-25T19:35:46.217ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69072024-11-25T19:35:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69082024-11-25T19:35:46.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69092024-11-25T19:35:46.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69102024-11-25T19:35:46.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69112024-11-25T19:35:46.221ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69122024-11-25T19:35:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69132024-11-25T19:35:46.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69142024-11-25T19:35:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69152024-11-25T19:35:46.221ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1371, tv_nsec: 765749320 } })
69162024-11-25T19:35:46.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69172024-11-25T19:35:46.221ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
69182024-11-25T19:35:46.222ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
69192024-11-25T19:35:46.222ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 17.513404ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
69202024-11-25T19:35:46.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69212024-11-25T19:35:46.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69222024-11-25T19:35:46.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69232024-11-25T19:35:46.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69242024-11-25T19:35:46.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69252024-11-25T19:35:46.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69262024-11-25T19:35:46.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69272024-11-25T19:35:46.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69282024-11-25T19:35:46.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
69292024-11-25T19:35:46.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69302024-11-25T19:35:46.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69312024-11-25T19:35:46.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69322024-11-25T19:35:46.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69332024-11-25T19:35:46.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69342024-11-25T19:35:46.238ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
69352024-11-25T19:35:46.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.923815ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
69362024-11-25T19:35:46.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69372024-11-25T19:35:46.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 35.123719ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
69382024-11-25T19:35:46.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69392024-11-25T19:35:46.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69402024-11-25T19:35:46.246ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69412024-11-25T19:35:46.246ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
69422024-11-25T19:35:46.246ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69432024-11-25T19:35:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69442024-11-25T19:35:46.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69452024-11-25T19:35:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69462024-11-25T19:35:46.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69472024-11-25T19:35:46.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 45.596385ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
69482024-11-25T19:35:46.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
69492024-11-25T19:35:46.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69502024-11-25T19:35:46.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69512024-11-25T19:35:46.253ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 49.002441ms iteration = 10 status = 0
69522024-11-25T19:35:46.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69532024-11-25T19:35:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69542024-11-25T19:35:46.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69552024-11-25T19:35:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69562024-11-25T19:35:46.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69572024-11-25T19:35:46.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69582024-11-25T19:35:46.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69592024-11-25T19:35:46.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69602024-11-25T19:35:46.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69612024-11-25T19:35:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69622024-11-25T19:35:46.265ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69632024-11-25T19:35:46.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69642024-11-25T19:35:46.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69652024-11-25T19:35:46.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69662024-11-25T19:35:46.270ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69672024-11-25T19:35:46.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69682024-11-25T19:35:46.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 67.715559ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
69692024-11-25T19:35:46.274ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
69702024-11-25T19:35:46.274ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69712024-11-25T19:35:46.274ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de261952-b26b-4d3c-8921-3cf775b3c199", "content-length": "26", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
69722024-11-25T19:35:46.274ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69732024-11-25T19:35:46.276ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69742024-11-25T19:35:46.281ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69752024-11-25T19:35:46.281ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
69762024-11-25T19:35:46.281ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 77.053332ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
69772024-11-25T19:35:46.294ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
69782024-11-25T19:35:46.294ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69792024-11-25T19:35:46.294ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "700a0b03-a867-444b-90fd-ec9293da264d", "content-length": "26", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
69802024-11-25T19:35:46.294ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69812024-11-25T19:35:46.296ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69822024-11-25T19:35:46.311ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 106.785835ms iteration = 12 status = {"physical_disks_added":0}
69832024-11-25T19:35:46.324ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
69842024-11-25T19:35:46.324ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69852024-11-25T19:35:46.324ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6cad91f-1ef1-4e1c-994b-db8f22ef2f35", "content-length": "26", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
69862024-11-25T19:35:46.324ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69872024-11-25T19:35:46.326ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
69882024-11-25T19:35:46.521ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69892024-11-25T19:35:46.521ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aeee948-859e-4798-89cb-13f1fbb0b8fd", "content-length": "691", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
69902024-11-25T19:35:46.521ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69912024-11-25T19:35:46.521ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69922024-11-25T19:35:46.521ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69932024-11-25T19:35:46.522ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 317.859397ms iteration = 10 status = {}
69942024-11-25T19:35:46.656ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69952024-11-25T19:35:46.656ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69962024-11-25T19:35:46.656ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "47666196-f894-4ae4-b7ba-b8805a82dd4b", "content-length": "372", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
69972024-11-25T19:35:46.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69982024-11-25T19:35:46.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69992024-11-25T19:35:46.658ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
70002024-11-25T19:35:46.659ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f3bf158-d04b-4294-b66e-818d84ff3b2c", "content-length": "1", "date": "Mon, 25 Nov 2024 19:35:45 GMT"} })
70012024-11-25T19:35:46.660ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70022024-11-25T19:35:46.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70032024-11-25T19:35:46.661ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 457.18108ms iteration = 10 status = null
70042024-11-25T19:35:46.662ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 458.127699ms iteration = 10 status = {}
70052024-11-25T19:35:46.669ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
70062024-11-25T19:35:46.669ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
70072024-11-25T19:35:46.669ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7d34cdc8-385d-4b79-9bb6-17d3b3f83684", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
70082024-11-25T19:35:46.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70092024-11-25T19:35:46.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70102024-11-25T19:35:46.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70112024-11-25T19:35:46.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70122024-11-25T19:35:46.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70132024-11-25T19:35:46.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70142024-11-25T19:35:46.677ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
70152024-11-25T19:35:46.677ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70162024-11-25T19:35:46.677ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "98832850-1b3f-4f90-9d12-38b09ff0a2eb", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
70172024-11-25T19:35:46.679ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 475.227984ms iteration = 11 status = {}
70182024-11-25T19:35:46.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70192024-11-25T19:35:46.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70202024-11-25T19:35:46.701ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
70212024-11-25T19:35:46.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70222024-11-25T19:35:46.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70232024-11-25T19:35:46.708ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
70242024-11-25T19:35:46.708ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd115e51-fa8e-42bf-ab67-787b68b05e73", "content-length": "134", "date": "Mon, 25 Nov 2024 19:35:45 GMT"} })
70252024-11-25T19:35:46.708ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
70262024-11-25T19:35:46.708ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
70272024-11-25T19:35:46.708ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
70282024-11-25T19:35:46.708ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70292024-11-25T19:35:46.708ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70302024-11-25T19:35:46.708ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70312024-11-25T19:35:46.708ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70322024-11-25T19:35:46.708ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70332024-11-25T19:35:46.709ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70342024-11-25T19:35:46.709ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70352024-11-25T19:35:46.709ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
70362024-11-25T19:35:46.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70372024-11-25T19:35:46.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70382024-11-25T19:35:46.710ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
70392024-11-25T19:35:46.710ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "98719147-cff6-48c7-86c9-13eb1876640b", "content-length": "2", "date": "Mon, 25 Nov 2024 19:35:45 GMT"} })
70402024-11-25T19:35:46.710ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
70412024-11-25T19:35:46.711ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb7efbdf-e5ec-4b51-8998-aeee7ed18df8", "content-length": "51", "date": "Mon, 25 Nov 2024 19:35:45 GMT"} })
70422024-11-25T19:35:46.711ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
70432024-11-25T19:35:46.711ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
70442024-11-25T19:35:46.800ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4d76ef12-b937-407d-8ec9-c91f88d2a01e", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
70452024-11-25T19:35:46.800ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
70462024-11-25T19:35:46.800ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
70472024-11-25T19:35:46.800ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ce92bb7-6dfc-4cab-9bfd-48662eb292ef", "content-length": "682", "date": "Mon, 25 Nov 2024 19:35:46 GMT"} })
70482024-11-25T19:35:46.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70492024-11-25T19:35:46.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70502024-11-25T19:35:46.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70512024-11-25T19:35:46.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70522024-11-25T19:35:46.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70532024-11-25T19:35:46.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70542024-11-25T19:35:46.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70552024-11-25T19:35:46.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70562024-11-25T19:35:46.816ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 611.61667ms iteration = 10 status = {}
70572024-11-25T19:35:47.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1113 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 9b5a6fbd-bd37-498d-8a35-63d810238f75 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
70582024-11-25T19:35:52.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 3d843658-1eb9-4f69-8122-86cf242f7c83 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
70592024-11-25T19:35:52.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 3d843658-1eb9-4f69-8122-86cf242f7c83 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
70602024-11-25T19:35:52.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 3d843658-1eb9-4f69-8122-86cf242f7c83 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
70612024-11-25T19:35:52.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = df9cd3a0-bdbc-44ed-a4b4-cf31d57e7606 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
70622024-11-25T19:35:52.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = df9cd3a0-bdbc-44ed-a4b4-cf31d57e7606 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
70632024-11-25T19:35:52.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = df9cd3a0-bdbc-44ed-a4b4-cf31d57e7606 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
70642024-11-25T19:35:56.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
70652024-11-25T19:35:56.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
70662024-11-25T19:35:56.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70672024-11-25T19:35:56.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70682024-11-25T19:35:56.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70692024-11-25T19:35:56.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70702024-11-25T19:35:56.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70712024-11-25T19:35:56.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70722024-11-25T19:35:56.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70732024-11-25T19:35:56.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70742024-11-25T19:35:56.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70752024-11-25T19:35:56.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70762024-11-25T19:35:56.206ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.549219ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70772024-11-25T19:35:56.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70782024-11-25T19:35:56.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70792024-11-25T19:35:56.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70802024-11-25T19:35:56.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
70812024-11-25T19:35:56.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70822024-11-25T19:35:56.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70832024-11-25T19:35:56.222ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
70842024-11-25T19:35:56.222ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.327398ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
70852024-11-25T19:35:57.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1479 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 9c0c1c5c-c19b-4279-9edc-69e85ac48ec2 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
70862024-11-25T19:36:06.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
70872024-11-25T19:36:06.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
70882024-11-25T19:36:06.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70892024-11-25T19:36:06.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70902024-11-25T19:36:06.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70912024-11-25T19:36:06.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70922024-11-25T19:36:06.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70932024-11-25T19:36:06.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70942024-11-25T19:36:06.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70952024-11-25T19:36:06.206ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.138882ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70962024-11-25T19:36:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70972024-11-25T19:36:06.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70982024-11-25T19:36:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70992024-11-25T19:36:06.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71002024-11-25T19:36:06.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71012024-11-25T19:36:06.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71022024-11-25T19:36:06.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
71032024-11-25T19:36:06.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71042024-11-25T19:36:06.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71052024-11-25T19:36:06.224ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
71062024-11-25T19:36:06.224ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.91949ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
71072024-11-25T19:36:07.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = f149369c-3592-4a64-8c9b-000c658584b1 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
71082024-11-25T19:36:07.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = f149369c-3592-4a64-8c9b-000c658584b1 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
71092024-11-25T19:36:07.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = f149369c-3592-4a64-8c9b-000c658584b1 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
71102024-11-25T19:36:07.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 5848c8ad-a1a9-48f7-a020-0b2d4974f362 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
71112024-11-25T19:36:07.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 5848c8ad-a1a9-48f7-a020-0b2d4974f362 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
71122024-11-25T19:36:07.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 5848c8ad-a1a9-48f7-a020-0b2d4974f362 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
71132024-11-25T19:36:07.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1104 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = bcdf4542-e969-4cbb-94d9-62850a647ccb response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
71142024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
71152024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
71162024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71172024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
71182024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
71192024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71202024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
71212024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
71222024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
71232024-11-25T19:36:16.202ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:26:16.202677737 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
71242024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
71252024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
71262024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
71272024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71282024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71292024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
71302024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
71312024-11-25T19:36:16.202ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71322024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
71332024-11-25T19:36:16.203ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
71342024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
71352024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.01\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
71362024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71372024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
71382024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
71392024-11-25T19:36:16.203ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
71402024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
71412024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
71422024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71432024-11-25T19:36:16.203ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71442024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
71452024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71462024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71472024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
71482024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71492024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
71502024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71512024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
71522024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
71532024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
71542024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71552024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
71562024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
71572024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
71582024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71592024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71602024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71612024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
71622024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
71632024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
71642024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
71652024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71662024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
71672024-11-25T19:36:16.203ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
71682024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71692024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
71702024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
71712024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
71722024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71732024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71742024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
71752024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71762024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
71772024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71782024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
71792024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71802024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71812024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
71822024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
71832024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71842024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71852024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71862024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71872024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71882024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71892024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71902024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71912024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71922024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
71932024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
71942024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71952024-11-25T19:36:16.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71962024-11-25T19:36:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71972024-11-25T19:36:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71982024-11-25T19:36:16.204ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1401, tv_nsec: 750236596 } })
71992024-11-25T19:36:16.204ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1401, tv_nsec: 750237325 } })
72002024-11-25T19:36:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72012024-11-25T19:36:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72022024-11-25T19:36:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
72032024-11-25T19:36:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72042024-11-25T19:36:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72052024-11-25T19:36:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72062024-11-25T19:36:16.204ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
72072024-11-25T19:36:16.204ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.615052ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
72082024-11-25T19:36:16.204ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
72092024-11-25T19:36:16.204ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.436088ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
72102024-11-25T19:36:16.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72112024-11-25T19:36:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72122024-11-25T19:36:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.434458ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72132024-11-25T19:36:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72142024-11-25T19:36:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.196082ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
72152024-11-25T19:36:16.206ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:26:16.202677737 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
72162024-11-25T19:36:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.265023ms iteration = 6 status = {"expiration":"2024-11-25T19:26:16.202677737Z","pruned":[]}
72172024-11-25T19:36:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72182024-11-25T19:36:16.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72192024-11-25T19:36:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72202024-11-25T19:36:16.207ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72212024-11-25T19:36:16.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72222024-11-25T19:36:16.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72232024-11-25T19:36:16.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72242024-11-25T19:36:16.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72252024-11-25T19:36:16.209ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72262024-11-25T19:36:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72272024-11-25T19:36:16.209ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.842095ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
72282024-11-25T19:36:16.209ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72292024-11-25T19:36:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72302024-11-25T19:36:16.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72312024-11-25T19:36:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72322024-11-25T19:36:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
72332024-11-25T19:36:16.212ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72342024-11-25T19:36:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72352024-11-25T19:36:16.213ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1401, tv_nsec: 760086099 } })
72362024-11-25T19:36:16.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72372024-11-25T19:36:16.213ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
72382024-11-25T19:36:16.214ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72392024-11-25T19:36:16.214ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72402024-11-25T19:36:16.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72412024-11-25T19:36:16.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72422024-11-25T19:36:16.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72432024-11-25T19:36:16.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72442024-11-25T19:36:16.215ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72452024-11-25T19:36:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72462024-11-25T19:36:16.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72472024-11-25T19:36:16.215ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
72482024-11-25T19:36:16.215ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
72492024-11-25T19:36:16.215ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 12.346792ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
72502024-11-25T19:36:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72512024-11-25T19:36:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72522024-11-25T19:36:16.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72532024-11-25T19:36:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72542024-11-25T19:36:16.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72552024-11-25T19:36:16.218ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72562024-11-25T19:36:16.219ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72572024-11-25T19:36:16.220ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72582024-11-25T19:36:16.220ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1401, tv_nsec: 766438143 } })
72592024-11-25T19:36:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72602024-11-25T19:36:16.220ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
72612024-11-25T19:36:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72622024-11-25T19:36:16.220ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72632024-11-25T19:36:16.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72642024-11-25T19:36:16.221ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72652024-11-25T19:36:16.221ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72662024-11-25T19:36:16.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72672024-11-25T19:36:16.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72682024-11-25T19:36:16.221ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72692024-11-25T19:36:16.223ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.533083ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72702024-11-25T19:36:16.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72712024-11-25T19:36:16.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72722024-11-25T19:36:16.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72732024-11-25T19:36:16.224ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1401, tv_nsec: 770524194 } })
72742024-11-25T19:36:16.224ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
72752024-11-25T19:36:16.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72762024-11-25T19:36:16.225ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72772024-11-25T19:36:16.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72782024-11-25T19:36:16.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72792024-11-25T19:36:16.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72802024-11-25T19:36:16.226ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72812024-11-25T19:36:16.226ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72822024-11-25T19:36:16.226ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72832024-11-25T19:36:16.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72842024-11-25T19:36:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72852024-11-25T19:36:16.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72862024-11-25T19:36:16.232ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72872024-11-25T19:36:16.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72882024-11-25T19:36:16.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72892024-11-25T19:36:16.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72902024-11-25T19:36:16.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72912024-11-25T19:36:16.236ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72922024-11-25T19:36:16.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72932024-11-25T19:36:16.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72942024-11-25T19:36:16.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 34.503177ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
72952024-11-25T19:36:16.238ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72962024-11-25T19:36:16.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72972024-11-25T19:36:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72982024-11-25T19:36:16.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72992024-11-25T19:36:16.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73002024-11-25T19:36:16.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 39.092217ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
73012024-11-25T19:36:16.242ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73022024-11-25T19:36:16.242ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 39.431573ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73032024-11-25T19:36:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
73042024-11-25T19:36:16.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73052024-11-25T19:36:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73062024-11-25T19:36:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
73072024-11-25T19:36:16.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73082024-11-25T19:36:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73092024-11-25T19:36:16.246ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73102024-11-25T19:36:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73112024-11-25T19:36:16.248ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73122024-11-25T19:36:16.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73132024-11-25T19:36:16.249ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73142024-11-25T19:36:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73152024-11-25T19:36:16.251ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73162024-11-25T19:36:16.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
73172024-11-25T19:36:16.255ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73182024-11-25T19:36:16.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73192024-11-25T19:36:16.255ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73202024-11-25T19:36:16.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73212024-11-25T19:36:16.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
73222024-11-25T19:36:16.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.592592ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
73232024-11-25T19:36:16.256ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73242024-11-25T19:36:16.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73252024-11-25T19:36:16.257ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73262024-11-25T19:36:16.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73272024-11-25T19:36:16.263ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73282024-11-25T19:36:16.264ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
73292024-11-25T19:36:16.264ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
73302024-11-25T19:36:16.264ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 61.790503ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
73312024-11-25T19:36:16.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
73322024-11-25T19:36:16.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73332024-11-25T19:36:16.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73342024-11-25T19:36:16.272ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
73352024-11-25T19:36:16.272ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
73362024-11-25T19:36:16.272ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
73372024-11-25T19:36:16.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73382024-11-25T19:36:16.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73392024-11-25T19:36:16.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.419631ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73402024-11-25T19:36:16.274ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
73412024-11-25T19:36:16.274ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
73422024-11-25T19:36:16.274ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
73432024-11-25T19:36:16.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73442024-11-25T19:36:16.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73452024-11-25T19:36:16.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73462024-11-25T19:36:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73472024-11-25T19:36:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73482024-11-25T19:36:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73492024-11-25T19:36:16.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73502024-11-25T19:36:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73512024-11-25T19:36:16.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73522024-11-25T19:36:16.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73532024-11-25T19:36:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73542024-11-25T19:36:16.278ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73552024-11-25T19:36:16.278ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73562024-11-25T19:36:16.278ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73572024-11-25T19:36:16.278ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 75.318758ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
73582024-11-25T19:36:16.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73592024-11-25T19:36:16.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73602024-11-25T19:36:16.280ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
73612024-11-25T19:36:16.280ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
73622024-11-25T19:36:16.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73632024-11-25T19:36:16.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73642024-11-25T19:36:16.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73652024-11-25T19:36:16.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73662024-11-25T19:36:16.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73672024-11-25T19:36:16.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73682024-11-25T19:36:16.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73692024-11-25T19:36:16.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73702024-11-25T19:36:16.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73712024-11-25T19:36:16.285ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
73722024-11-25T19:36:16.285ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
73732024-11-25T19:36:16.285ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73742024-11-25T19:36:16.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73752024-11-25T19:36:16.285ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73762024-11-25T19:36:16.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73772024-11-25T19:36:16.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73782024-11-25T19:36:16.286ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73792024-11-25T19:36:16.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73802024-11-25T19:36:16.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73812024-11-25T19:36:16.287ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73822024-11-25T19:36:16.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73832024-11-25T19:36:16.287ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
73842024-11-25T19:36:16.287ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
73852024-11-25T19:36:16.287ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
73862024-11-25T19:36:16.287ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 84.662172ms iteration = 7 status = {"generation":2}
73872024-11-25T19:36:16.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73882024-11-25T19:36:16.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
73892024-11-25T19:36:16.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73902024-11-25T19:36:16.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73912024-11-25T19:36:16.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73922024-11-25T19:36:16.290ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73932024-11-25T19:36:16.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73942024-11-25T19:36:16.291ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73952024-11-25T19:36:16.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73962024-11-25T19:36:16.291ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73972024-11-25T19:36:16.292ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.351843ms iteration = 11 status = 0
73982024-11-25T19:36:16.292ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73992024-11-25T19:36:16.293ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74002024-11-25T19:36:16.293ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
74012024-11-25T19:36:16.293ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
74022024-11-25T19:36:16.293ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
74032024-11-25T19:36:16.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74042024-11-25T19:36:16.293ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 90.088138ms iteration = 7 status = {"generation":1}
74052024-11-25T19:36:16.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
74062024-11-25T19:36:16.293ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74072024-11-25T19:36:16.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74082024-11-25T19:36:16.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74092024-11-25T19:36:16.295ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74102024-11-25T19:36:16.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74112024-11-25T19:36:16.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74122024-11-25T19:36:16.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74132024-11-25T19:36:16.307ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
74142024-11-25T19:36:16.307ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 104.592312ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
74152024-11-25T19:36:16.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74162024-11-25T19:36:16.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
74172024-11-25T19:36:16.327ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74182024-11-25T19:36:16.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74192024-11-25T19:36:16.329ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74202024-11-25T19:36:16.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74212024-11-25T19:36:16.331ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74222024-11-25T19:36:16.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74232024-11-25T19:36:16.333ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
74242024-11-25T19:36:16.336ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74252024-11-25T19:36:16.337ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.905077ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
74262024-11-25T19:36:16.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74272024-11-25T19:36:16.339ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74282024-11-25T19:36:16.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74292024-11-25T19:36:16.341ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74302024-11-25T19:36:16.341ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
74312024-11-25T19:36:16.341ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 138.380305ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
74322024-11-25T19:36:16.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74332024-11-25T19:36:16.342ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
74342024-11-25T19:36:16.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74352024-11-25T19:36:16.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74362024-11-25T19:36:16.371ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74372024-11-25T19:36:16.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74382024-11-25T19:36:16.372ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74392024-11-25T19:36:16.376ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
74402024-11-25T19:36:16.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74412024-11-25T19:36:16.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74422024-11-25T19:36:16.382ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
74432024-11-25T19:36:16.382ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74442024-11-25T19:36:16.382ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "91a891bd-ec5f-4867-8e91-35d06e7124cf", "content-length": "26", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
74452024-11-25T19:36:16.382ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74462024-11-25T19:36:16.384ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74472024-11-25T19:36:16.385ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
74482024-11-25T19:36:16.385ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74492024-11-25T19:36:16.385ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8624f297-aafd-4480-88f3-76058d31cc23", "content-length": "26", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
74502024-11-25T19:36:16.385ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74512024-11-25T19:36:16.387ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
74522024-11-25T19:36:16.404ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 201.460892ms iteration = 13 status = {"physical_disks_added":0}
74532024-11-25T19:36:16.409ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
74542024-11-25T19:36:16.409ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74552024-11-25T19:36:16.409ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "589be30a-2614-4b71-a9c3-8198c5aa76d7", "content-length": "26", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
74562024-11-25T19:36:16.409ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74572024-11-25T19:36:16.410ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74582024-11-25T19:36:16.444ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74592024-11-25T19:36:16.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74602024-11-25T19:36:16.490ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
74612024-11-25T19:36:16.490ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "06cc3221-c02c-4752-9be3-978f84d8776d", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
74622024-11-25T19:36:16.490ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
74632024-11-25T19:36:16.492ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ac8d282a-1384-4748-8b31-2fa828c5366e", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
74642024-11-25T19:36:16.492ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
74652024-11-25T19:36:16.493ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
74662024-11-25T19:36:16.493ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 290.621942ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
74672024-11-25T19:36:16.550ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
74682024-11-25T19:36:16.550ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d092bfa7-e43d-4f6b-ba3b-8040d9dc4f50", "content-length": "1", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
74692024-11-25T19:36:16.552ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74702024-11-25T19:36:16.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74712024-11-25T19:36:16.566ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 363.127535ms iteration = 11 status = {}
74722024-11-25T19:36:16.690ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
74732024-11-25T19:36:16.690ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74742024-11-25T19:36:16.690ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a318f77e-f5ee-492a-90c7-4dbb15ff42a6", "content-length": "372", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
74752024-11-25T19:36:16.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74762024-11-25T19:36:16.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74772024-11-25T19:36:16.691ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74782024-11-25T19:36:16.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74792024-11-25T19:36:16.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74802024-11-25T19:36:16.693ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74812024-11-25T19:36:16.693ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
74822024-11-25T19:36:16.693ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 490.640117ms iteration = 11 status = null
74832024-11-25T19:36:16.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74842024-11-25T19:36:16.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74852024-11-25T19:36:16.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74862024-11-25T19:36:16.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74872024-11-25T19:36:16.695ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74882024-11-25T19:36:16.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74892024-11-25T19:36:16.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74902024-11-25T19:36:16.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74912024-11-25T19:36:16.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74922024-11-25T19:36:16.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
74932024-11-25T19:36:16.699ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74942024-11-25T19:36:16.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74952024-11-25T19:36:16.705ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
74962024-11-25T19:36:16.705ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
74972024-11-25T19:36:16.705ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fcaef3c1-f30f-4339-9b69-252dde3e69e2", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
74982024-11-25T19:36:16.705ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74992024-11-25T19:36:16.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75002024-11-25T19:36:16.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75012024-11-25T19:36:16.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75022024-11-25T19:36:16.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75032024-11-25T19:36:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75042024-11-25T19:36:16.711ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75052024-11-25T19:36:16.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75062024-11-25T19:36:16.712ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
75072024-11-25T19:36:16.712ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75082024-11-25T19:36:16.713ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d0ba796e-0870-416c-a56b-15297d119d05", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
75092024-11-25T19:36:16.715ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 512.464085ms iteration = 12 status = {}
75102024-11-25T19:36:16.800ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
75112024-11-25T19:36:16.800ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a63a80d7-1f06-4c0f-a30e-3c5893078ac1", "content-length": "691", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
75122024-11-25T19:36:16.801ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
75132024-11-25T19:36:16.801ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
75142024-11-25T19:36:16.801ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
75152024-11-25T19:36:16.801ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 598.829319ms iteration = 11 status = {}
75162024-11-25T19:36:16.802ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75172024-11-25T19:36:16.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75182024-11-25T19:36:16.803ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75192024-11-25T19:36:16.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75202024-11-25T19:36:16.806ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75212024-11-25T19:36:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75222024-11-25T19:36:16.808ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75232024-11-25T19:36:16.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75242024-11-25T19:36:16.810ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75252024-11-25T19:36:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75262024-11-25T19:36:16.811ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75272024-11-25T19:36:16.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75282024-11-25T19:36:16.812ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75292024-11-25T19:36:16.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
75302024-11-25T19:36:16.815ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75312024-11-25T19:36:16.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75322024-11-25T19:36:16.817ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75332024-11-25T19:36:16.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75342024-11-25T19:36:16.818ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75352024-11-25T19:36:16.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75362024-11-25T19:36:16.819ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75372024-11-25T19:36:16.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
75382024-11-25T19:36:16.822ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75392024-11-25T19:36:16.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75402024-11-25T19:36:16.829ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
75412024-11-25T19:36:16.829ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75422024-11-25T19:36:16.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75432024-11-25T19:36:16.830ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75442024-11-25T19:36:16.832ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
75452024-11-25T19:36:16.832ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75462024-11-25T19:36:16.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75472024-11-25T19:36:16.834ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
75482024-11-25T19:36:16.834ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
75492024-11-25T19:36:16.834ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
75502024-11-25T19:36:16.853ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
75512024-11-25T19:36:16.854ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "194f05bb-3542-4f49-831d-b7342dc8a094", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75522024-11-25T19:36:16.854ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75532024-11-25T19:36:16.855ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b4cb341d-485c-403e-acb8-73e9dbb47617", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75542024-11-25T19:36:16.855ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75552024-11-25T19:36:16.857ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "bf8041d2-c46f-4b6e-bde4-ea7ef5c24465", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75562024-11-25T19:36:16.857ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75572024-11-25T19:36:16.859ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75582024-11-25T19:36:16.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 656.918709ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
75592024-11-25T19:36:16.896ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 38711855-ef69-4d79-bb75-aebd85b1280b, time_created: 2024-11-25T19:31:33.165388Z, time_modified: 2024-11-25T19:31:33.165388Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
75602024-11-25T19:36:16.896ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
75612024-11-25T19:36:16.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75622024-11-25T19:36:16.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75632024-11-25T19:36:16.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75642024-11-25T19:36:16.908ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75652024-11-25T19:36:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75662024-11-25T19:36:16.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75672024-11-25T19:36:16.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75682024-11-25T19:36:16.911ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
75692024-11-25T19:36:16.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75702024-11-25T19:36:16.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75712024-11-25T19:36:16.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
75722024-11-25T19:36:16.922ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
75732024-11-25T19:36:16.923ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3198624-e53a-4e08-9012-be22357fad97", "content-length": "134", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
75742024-11-25T19:36:16.923ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
75752024-11-25T19:36:16.923ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
75762024-11-25T19:36:16.923ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
75772024-11-25T19:36:16.923ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75782024-11-25T19:36:16.923ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75792024-11-25T19:36:16.923ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75802024-11-25T19:36:16.923ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75812024-11-25T19:36:16.923ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75822024-11-25T19:36:16.923ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75832024-11-25T19:36:16.924ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75842024-11-25T19:36:16.924ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
75852024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75862024-11-25T19:36:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75872024-11-25T19:36:16.928ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
75882024-11-25T19:36:16.928ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1164fc19-8957-4ce9-995f-ccc0a222248e", "content-length": "2", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
75892024-11-25T19:36:16.928ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
75902024-11-25T19:36:16.928ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dd37d31-672e-485c-a5bb-1af5fc3bccf7", "content-length": "51", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
75912024-11-25T19:36:16.928ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
75922024-11-25T19:36:16.928ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75932024-11-25T19:36:16.949ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
75942024-11-25T19:36:17.040ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9a55045a-7c11-4138-a234-d173e0bfd52d", "date": "Mon, 25 Nov 2024 19:36:16 GMT"} })
75952024-11-25T19:36:17.040ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
75962024-11-25T19:36:17.040ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75972024-11-25T19:36:17.040ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "670bf487-5ec7-4542-b53b-a4c6f415f6d3", "content-length": "682", "date": "Mon, 25 Nov 2024 19:36:17 GMT"} })
75982024-11-25T19:36:17.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75992024-11-25T19:36:17.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76002024-11-25T19:36:17.041ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "01205666-f081-4a05-8964-d7fa0eee4e34", "date": "Mon, 25 Nov 2024 19:36:17 GMT"} })
76012024-11-25T19:36:17.043ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
76022024-11-25T19:36:17.043ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 840.47057ms
76032024-11-25T19:36:17.043ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 840.48547ms iteration = 2 status = {}
76042024-11-25T19:36:17.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76052024-11-25T19:36:17.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76062024-11-25T19:36:17.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76072024-11-25T19:36:17.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76082024-11-25T19:36:17.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76092024-11-25T19:36:17.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76102024-11-25T19:36:17.060ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 857.976344ms iteration = 11 status = {}
76112024-11-25T19:36:17.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 6a731f9f-8c7d-42f8-a4fa-5af76b937daf response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
76122024-11-25T19:36:26.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
76132024-11-25T19:36:26.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
76142024-11-25T19:36:26.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76152024-11-25T19:36:26.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76162024-11-25T19:36:26.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76172024-11-25T19:36:26.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76182024-11-25T19:36:26.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76192024-11-25T19:36:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76202024-11-25T19:36:26.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76212024-11-25T19:36:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76222024-11-25T19:36:26.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76232024-11-25T19:36:26.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76242024-11-25T19:36:26.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76252024-11-25T19:36:26.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
76262024-11-25T19:36:26.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76272024-11-25T19:36:26.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76282024-11-25T19:36:26.229ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
76292024-11-25T19:36:26.229ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.408477ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
76302024-11-25T19:36:26.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76312024-11-25T19:36:26.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76322024-11-25T19:36:26.267ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.931444ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76332024-11-25T19:36:27.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1741 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = a420c84e-ae56-4575-8d37-2849a0b59732 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
76342024-11-25T19:36:28.615ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:39614
76352024-11-25T19:36:28.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39614 req_id = 9d3bb239-9069-446b-8afd-badb153de4e1 roles = RoleSet { roles: {} } uri = /metrics/producers
76362024-11-25T19:36:28.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39614 req_id = 9d3bb239-9069-446b-8afd-badb153de4e1 resource = Database result = Ok(()) uri = /metrics/producers
76372024-11-25T19:36:28.651ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 38711855-ef69-4d79-bb75-aebd85b1280b
76382024-11-25T19:36:28.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35657 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39614 req_id = 9d3bb239-9069-446b-8afd-badb153de4e1 response_code = 201 uri = /metrics/producers
76392024-11-25T19:36:35.110ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
76402024-11-25T19:36:35.110ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
76412024-11-25T19:36:35.141ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
76422024-11-25T19:36:35.141ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:50287
76432024-11-25T19:36:35.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50287 req_id = c8a3bc39-4022-4028-b77f-35902979da3b roles = RoleSet { roles: {} } uri = /metrics/producers
76442024-11-25T19:36:35.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50287 req_id = c8a3bc39-4022-4028-b77f-35902979da3b resource = Database result = Ok(()) uri = /metrics/producers
76452024-11-25T19:36:35.176ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
76462024-11-25T19:36:35.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35042 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50287 req_id = c8a3bc39-4022-4028-b77f-35902979da3b response_code = 201 uri = /metrics/producers
76472024-11-25T19:36:35.176ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "c8a3bc39-4022-4028-b77f-35902979da3b", "content-length": "41", "date": "Mon, 25 Nov 2024 19:36:35 GMT"} })
76482024-11-25T19:36:35.177ZDEBGnexus (producer-registration-task): registered with nexus successfully
76492024-11-25T19:36:35.177ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
76502024-11-25T19:36:36.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
76512024-11-25T19:36:36.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
76522024-11-25T19:36:36.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76532024-11-25T19:36:36.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76542024-11-25T19:36:36.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76552024-11-25T19:36:36.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76562024-11-25T19:36:36.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76572024-11-25T19:36:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76582024-11-25T19:36:36.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76592024-11-25T19:36:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76602024-11-25T19:36:36.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76612024-11-25T19:36:36.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76622024-11-25T19:36:36.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76632024-11-25T19:36:36.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
76642024-11-25T19:36:36.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76652024-11-25T19:36:36.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76662024-11-25T19:36:36.224ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
76672024-11-25T19:36:36.224ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.515801ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
76682024-11-25T19:36:36.231ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76692024-11-25T19:36:36.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76702024-11-25T19:36:36.259ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.134761ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76712024-11-25T19:36:37.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1664 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 0ce31caf-15c8-4e38-b776-9340e6b67cf3 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
76722024-11-25T19:36:37.657ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53325
76732024-11-25T19:36:37.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53325 req_id = f5f967ff-9c14-4144-a6a3-e2fda499f5c1 roles = RoleSet { roles: {} } uri = /metrics/producers
76742024-11-25T19:36:37.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53325 req_id = f5f967ff-9c14-4144-a6a3-e2fda499f5c1 resource = Database result = Ok(()) uri = /metrics/producers
76752024-11-25T19:36:37.691ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b2b2b805-c910-42f7-8bd4-d5f05a06bed3
76762024-11-25T19:36:37.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34133 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53325 req_id = f5f967ff-9c14-4144-a6a3-e2fda499f5c1 response_code = 201 uri = /metrics/producers
76772024-11-25T19:36:43.191ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:45071
76782024-11-25T19:36:43.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45071 req_id = 6bded92d-b5db-4179-a933-d1aeaf8c8adf roles = RoleSet { roles: {} } uri = /metrics/producers
76792024-11-25T19:36:43.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45071 req_id = 6bded92d-b5db-4179-a933-d1aeaf8c8adf resource = Database result = Ok(()) uri = /metrics/producers
76802024-11-25T19:36:43.201ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b59496f2-fc6d-46cb-9cf5-9b1a2e24358f
76812024-11-25T19:36:43.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10042 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45071 req_id = 6bded92d-b5db-4179-a933-d1aeaf8c8adf response_code = 201 uri = /metrics/producers
76822024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
76832024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76842024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
76852024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76862024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
76872024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
76882024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76892024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76902024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76912024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
76922024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76932024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
76942024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
76952024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76962024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76972024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
76982024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
76992024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77002024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77012024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
77022024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
77032024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77042024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
77052024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
77062024-11-25T19:36:46.202ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
77072024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
77082024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77092024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
77102024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
77112024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77122024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
77132024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77142024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77152024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
77162024-11-25T19:36:46.202ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
77172024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77182024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77192024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77202024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
77212024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77222024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77232024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77242024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77252024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77262024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77272024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77282024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77292024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
77302024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77312024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77322024-11-25T19:36:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77332024-11-25T19:36:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77342024-11-25T19:36:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77352024-11-25T19:36:46.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77362024-11-25T19:36:46.206ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.380086ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
77372024-11-25T19:36:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77382024-11-25T19:36:46.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77392024-11-25T19:36:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77402024-11-25T19:36:46.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77412024-11-25T19:36:46.209ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77422024-11-25T19:36:46.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1431, tv_nsec: 757257183 } })
77432024-11-25T19:36:46.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
77442024-11-25T19:36:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77452024-11-25T19:36:46.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77462024-11-25T19:36:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77472024-11-25T19:36:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77482024-11-25T19:36:46.211ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77492024-11-25T19:36:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77502024-11-25T19:36:46.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77512024-11-25T19:36:46.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77522024-11-25T19:36:46.215ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1431, tv_nsec: 761628909 } })
77532024-11-25T19:36:46.215ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
77542024-11-25T19:36:46.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77552024-11-25T19:36:46.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77562024-11-25T19:36:46.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77572024-11-25T19:36:46.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
77582024-11-25T19:36:46.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77592024-11-25T19:36:46.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77602024-11-25T19:36:46.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1431, tv_nsec: 765075627 } })
77612024-11-25T19:36:46.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
77622024-11-25T19:36:46.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77632024-11-25T19:36:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77642024-11-25T19:36:46.225ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77652024-11-25T19:36:46.225ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77662024-11-25T19:36:46.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77672024-11-25T19:36:46.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77682024-11-25T19:36:46.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77692024-11-25T19:36:46.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
77702024-11-25T19:36:46.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77712024-11-25T19:36:46.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77722024-11-25T19:36:46.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 39.451384ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
77732024-11-25T19:36:46.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77742024-11-25T19:36:46.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77752024-11-25T19:36:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77762024-11-25T19:36:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77772024-11-25T19:36:46.248ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77782024-11-25T19:36:46.248ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77792024-11-25T19:36:46.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77802024-11-25T19:36:46.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77812024-11-25T19:36:46.249ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
77822024-11-25T19:36:46.249ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.424381ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
77832024-11-25T19:36:46.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77842024-11-25T19:36:46.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77852024-11-25T19:36:46.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.362597ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
77862024-11-25T19:36:46.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77872024-11-25T19:36:46.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77882024-11-25T19:36:46.259ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.947187ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77892024-11-25T19:36:46.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77902024-11-25T19:36:46.262ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77912024-11-25T19:36:46.262ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 59.812854ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77922024-11-25T19:36:46.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77932024-11-25T19:36:46.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77942024-11-25T19:36:46.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77952024-11-25T19:36:46.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77962024-11-25T19:36:46.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77972024-11-25T19:36:46.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77982024-11-25T19:36:46.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77992024-11-25T19:36:46.269ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78002024-11-25T19:36:46.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78012024-11-25T19:36:46.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78022024-11-25T19:36:46.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78032024-11-25T19:36:46.280ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78042024-11-25T19:36:46.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78052024-11-25T19:36:46.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.232583ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
78062024-11-25T19:36:46.288ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.202481ms iteration = 14 status = {"physical_disks_added":0}
78072024-11-25T19:36:46.289ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78082024-11-25T19:36:46.289ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78092024-11-25T19:36:46.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78102024-11-25T19:36:46.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78112024-11-25T19:36:46.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.757982ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78122024-11-25T19:36:46.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78132024-11-25T19:36:46.301ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78142024-11-25T19:36:46.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78152024-11-25T19:36:46.303ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
78162024-11-25T19:36:46.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78172024-11-25T19:36:46.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78182024-11-25T19:36:46.306ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.46842ms iteration = 12 status = 0
78192024-11-25T19:36:46.314ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
78202024-11-25T19:36:46.314ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78212024-11-25T19:36:46.315ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6aeaa2d-146f-4b70-8250-b888504a16ef", "content-length": "26", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
78222024-11-25T19:36:46.315ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78232024-11-25T19:36:46.316ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78242024-11-25T19:36:46.320ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78252024-11-25T19:36:46.320ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78262024-11-25T19:36:46.320ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.875243ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78272024-11-25T19:36:46.329ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 126.652014ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
78282024-11-25T19:36:46.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78292024-11-25T19:36:46.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78302024-11-25T19:36:46.403ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
78312024-11-25T19:36:46.403ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78322024-11-25T19:36:46.403ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7acda74a-f979-4dd3-9b61-6a9ee6d63980", "content-length": "26", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
78332024-11-25T19:36:46.403ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78342024-11-25T19:36:46.405ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78352024-11-25T19:36:46.420ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
78362024-11-25T19:36:46.420ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78372024-11-25T19:36:46.420ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41bddd5a-b720-493a-bec6-12d93ae79253", "content-length": "26", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
78382024-11-25T19:36:46.420ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78392024-11-25T19:36:46.422ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
78402024-11-25T19:36:46.432ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78412024-11-25T19:36:46.432ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1ac5922-290b-4c75-a0e6-70f53f0b2c6e", "content-length": "1", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
78422024-11-25T19:36:46.434ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78432024-11-25T19:36:46.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78442024-11-25T19:36:46.443ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
78452024-11-25T19:36:46.443ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78462024-11-25T19:36:46.443ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a38cce2-f45b-48d9-9b89-e4860d0c831a", "content-length": "372", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
78472024-11-25T19:36:46.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78482024-11-25T19:36:46.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78492024-11-25T19:36:46.445ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 243.169691ms iteration = 12 status = null
78502024-11-25T19:36:46.484ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 281.737867ms iteration = 12 status = {}
78512024-11-25T19:36:46.484ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
78522024-11-25T19:36:46.484ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78532024-11-25T19:36:46.484ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1ab52dcd-7b9b-4407-8e82-a4aab7065a84", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
78542024-11-25T19:36:46.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78552024-11-25T19:36:46.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78562024-11-25T19:36:46.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78572024-11-25T19:36:46.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78582024-11-25T19:36:46.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78592024-11-25T19:36:46.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78602024-11-25T19:36:46.493ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78612024-11-25T19:36:46.493ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78622024-11-25T19:36:46.494ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bd0d0032-6532-4b40-b73d-16725fe8dc37", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
78632024-11-25T19:36:46.495ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 292.915687ms iteration = 13 status = {}
78642024-11-25T19:36:46.536ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78652024-11-25T19:36:46.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78662024-11-25T19:36:46.538ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78672024-11-25T19:36:46.540ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78682024-11-25T19:36:46.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78692024-11-25T19:36:46.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78702024-11-25T19:36:46.542ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78712024-11-25T19:36:46.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78722024-11-25T19:36:46.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78732024-11-25T19:36:46.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78742024-11-25T19:36:46.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78752024-11-25T19:36:46.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78762024-11-25T19:36:46.554ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
78772024-11-25T19:36:46.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78782024-11-25T19:36:46.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78792024-11-25T19:36:46.563ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78802024-11-25T19:36:46.564ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "af0bfc28-3b56-4dba-90c5-27b9a7304123", "content-length": "134", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
78812024-11-25T19:36:46.564ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
78822024-11-25T19:36:46.564ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
78832024-11-25T19:36:46.564ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
78842024-11-25T19:36:46.564ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78852024-11-25T19:36:46.564ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78862024-11-25T19:36:46.564ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78872024-11-25T19:36:46.564ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78882024-11-25T19:36:46.564ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78892024-11-25T19:36:46.564ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78902024-11-25T19:36:46.564ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78912024-11-25T19:36:46.565ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
78922024-11-25T19:36:46.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78932024-11-25T19:36:46.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78942024-11-25T19:36:46.567ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78952024-11-25T19:36:46.567ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8ff0123-c3a2-4351-8d7d-f19cc560a641", "content-length": "2", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
78962024-11-25T19:36:46.567ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78972024-11-25T19:36:46.567ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c987792-7be5-4109-903c-e067a858a80f", "content-length": "51", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
78982024-11-25T19:36:46.567ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
78992024-11-25T19:36:46.567ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79002024-11-25T19:36:46.579ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79012024-11-25T19:36:46.664ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "811b5f83-06fe-4289-bc57-9a5cea278ed7", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
79022024-11-25T19:36:46.664ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
79032024-11-25T19:36:46.664ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
79042024-11-25T19:36:46.665ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "17abc587-3118-4077-a3b0-c0ac61b0d69f", "content-length": "682", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
79052024-11-25T19:36:46.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79062024-11-25T19:36:46.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79072024-11-25T19:36:46.665ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1b9b659-e0d1-493e-b5dc-c8638f0c912e", "content-length": "691", "date": "Mon, 25 Nov 2024 19:36:46 GMT"} })
79082024-11-25T19:36:46.665ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
79092024-11-25T19:36:46.665ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
79102024-11-25T19:36:46.665ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
79112024-11-25T19:36:46.667ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 465.165416ms iteration = 12 status = {}
79122024-11-25T19:36:46.668ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79132024-11-25T19:36:46.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79142024-11-25T19:36:46.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79152024-11-25T19:36:46.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79162024-11-25T19:36:46.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79172024-11-25T19:36:46.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79182024-11-25T19:36:46.681ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 479.170521ms iteration = 12 status = {}
79192024-11-25T19:36:47.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1156 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 28345cf7-7641-4ab7-b3aa-f30a676047b9 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
79202024-11-25T19:36:56.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
79212024-11-25T19:36:56.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79222024-11-25T19:36:56.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
79232024-11-25T19:36:56.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79242024-11-25T19:36:56.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79252024-11-25T19:36:56.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79262024-11-25T19:36:56.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79272024-11-25T19:36:56.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79282024-11-25T19:36:56.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79292024-11-25T19:36:56.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79302024-11-25T19:36:56.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79312024-11-25T19:36:56.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79322024-11-25T19:36:56.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79332024-11-25T19:36:56.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
79342024-11-25T19:36:56.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79352024-11-25T19:36:56.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79362024-11-25T19:36:56.228ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
79372024-11-25T19:36:56.228ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.211894ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
79382024-11-25T19:36:56.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79392024-11-25T19:36:56.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79402024-11-25T19:36:56.266ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.903464ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79412024-11-25T19:36:57.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1320 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 35b4b9da-b409-44ce-b4c4-a0a0c3aad09e response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
79422024-11-25T19:37:06.202ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
79432024-11-25T19:37:06.202ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79442024-11-25T19:37:06.202ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
79452024-11-25T19:37:06.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79462024-11-25T19:37:06.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79472024-11-25T19:37:06.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79482024-11-25T19:37:06.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79492024-11-25T19:37:06.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79502024-11-25T19:37:06.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79512024-11-25T19:37:06.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79522024-11-25T19:37:06.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79532024-11-25T19:37:06.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79542024-11-25T19:37:06.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79552024-11-25T19:37:06.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79562024-11-25T19:37:06.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79572024-11-25T19:37:06.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
79582024-11-25T19:37:06.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79592024-11-25T19:37:06.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79602024-11-25T19:37:06.225ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
79612024-11-25T19:37:06.225ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.882309ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
79622024-11-25T19:37:06.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.027608ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79632024-11-25T19:37:06.327ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:47011
79642024-11-25T19:37:06.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47011 req_id = 6a454905-7024-40af-a2e1-dadce20a670a roles = RoleSet { roles: {} } uri = /metrics/producers
79652024-11-25T19:37:06.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47011 req_id = 6a454905-7024-40af-a2e1-dadce20a670a resource = Database result = Ok(()) uri = /metrics/producers
79662024-11-25T19:37:06.337ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = e1e4675c-73a5-46b5-9e0f-9d05cbba5670
79672024-11-25T19:37:06.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9590 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47011 req_id = 6a454905-7024-40af-a2e1-dadce20a670a response_code = 201 uri = /metrics/producers
79682024-11-25T19:37:07.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 174d79b2-03cd-48c9-9a3b-74e4074f3657 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
79692024-11-25T19:37:07.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 174d79b2-03cd-48c9-9a3b-74e4074f3657 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
79702024-11-25T19:37:07.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 174d79b2-03cd-48c9-9a3b-74e4074f3657 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
79712024-11-25T19:37:07.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 784f1703-003c-447e-861c-fa74c42ac4b4 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
79722024-11-25T19:37:07.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 784f1703-003c-447e-861c-fa74c42ac4b4 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
79732024-11-25T19:37:07.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 784f1703-003c-447e-861c-fa74c42ac4b4 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
79742024-11-25T19:37:07.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1579 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 164ac1c0-1f25-4204-b65f-d7275bc8007b response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
79752024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
79762024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79772024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
79782024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
79792024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
79802024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
79812024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
79822024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79832024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
79842024-11-25T19:37:16.203ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
79852024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79862024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
79872024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79882024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
79892024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79902024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
79912024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
79922024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
79932024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79942024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
79952024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
79962024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79972024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
79982024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
79992024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
80002024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
80012024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
80022024-11-25T19:37:16.203ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:27:16.203763660 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
80032024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
80042024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
80052024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
80062024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80072024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
80082024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80092024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
80102024-11-25T19:37:16.203ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
80112024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
80122024-11-25T19:37:16.203ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80132024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.35\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
80142024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80152024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
80162024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80172024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
80182024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80192024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
80202024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
80212024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
80222024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80232024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80242024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
80252024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
80262024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
80272024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
80282024-11-25T19:37:16.204ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
80292024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80302024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80312024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
80322024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
80332024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80342024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
80352024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80362024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
80372024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
80382024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80392024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80402024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80412024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
80422024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80432024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80442024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80452024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80462024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80472024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80482024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
80492024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80502024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80512024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80522024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
80532024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80542024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80552024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80562024-11-25T19:37:16.204ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1461, tv_nsec: 750493401 } })
80572024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
80582024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80592024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
80602024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80612024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80622024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80632024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80642024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80652024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80662024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80672024-11-25T19:37:16.204ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1461, tv_nsec: 750756346 } })
80682024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80692024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80702024-11-25T19:37:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80712024-11-25T19:37:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80722024-11-25T19:37:16.205ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
80732024-11-25T19:37:16.205ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80742024-11-25T19:37:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.220364ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
80752024-11-25T19:37:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80762024-11-25T19:37:16.205ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
80772024-11-25T19:37:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.721894ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
80782024-11-25T19:37:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.240513ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80792024-11-25T19:37:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.344136ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
80802024-11-25T19:37:16.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80812024-11-25T19:37:16.208ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80822024-11-25T19:37:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80832024-11-25T19:37:16.209ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80842024-11-25T19:37:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80852024-11-25T19:37:16.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80862024-11-25T19:37:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80872024-11-25T19:37:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
80882024-11-25T19:37:16.211ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80892024-11-25T19:37:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80902024-11-25T19:37:16.212ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
80912024-11-25T19:37:16.212ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
80922024-11-25T19:37:16.212ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.554188ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
80932024-11-25T19:37:16.212ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:27:16.203763660 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
80942024-11-25T19:37:16.212ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.993016ms iteration = 7 status = {"expiration":"2024-11-25T19:27:16.203763660Z","pruned":[]}
80952024-11-25T19:37:16.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80962024-11-25T19:37:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80972024-11-25T19:37:16.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80982024-11-25T19:37:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80992024-11-25T19:37:16.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81002024-11-25T19:37:16.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81012024-11-25T19:37:16.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81022024-11-25T19:37:16.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
81032024-11-25T19:37:16.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
81042024-11-25T19:37:16.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81052024-11-25T19:37:16.220ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.527154ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
81062024-11-25T19:37:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81072024-11-25T19:37:16.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81082024-11-25T19:37:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81092024-11-25T19:37:16.220ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1461, tv_nsec: 766733299 } })
81102024-11-25T19:37:16.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81112024-11-25T19:37:16.221ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
81122024-11-25T19:37:16.221ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1461, tv_nsec: 767206668 } })
81132024-11-25T19:37:16.221ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81142024-11-25T19:37:16.221ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
81152024-11-25T19:37:16.224ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1461, tv_nsec: 769989063 } })
81162024-11-25T19:37:16.224ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
81172024-11-25T19:37:16.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81182024-11-25T19:37:16.224ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81192024-11-25T19:37:16.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81202024-11-25T19:37:16.224ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81212024-11-25T19:37:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81222024-11-25T19:37:16.227ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81232024-11-25T19:37:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81242024-11-25T19:37:16.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81252024-11-25T19:37:16.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81262024-11-25T19:37:16.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81272024-11-25T19:37:16.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81282024-11-25T19:37:16.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81292024-11-25T19:37:16.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81302024-11-25T19:37:16.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81312024-11-25T19:37:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81322024-11-25T19:37:16.240ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
81332024-11-25T19:37:16.240ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
81342024-11-25T19:37:16.240ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
81352024-11-25T19:37:16.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81362024-11-25T19:37:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81372024-11-25T19:37:16.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81382024-11-25T19:37:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
81392024-11-25T19:37:16.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81402024-11-25T19:37:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81412024-11-25T19:37:16.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81422024-11-25T19:37:16.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.309118ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
81432024-11-25T19:37:16.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81442024-11-25T19:37:16.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81452024-11-25T19:37:16.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81462024-11-25T19:37:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81472024-11-25T19:37:16.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81482024-11-25T19:37:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81492024-11-25T19:37:16.254ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81502024-11-25T19:37:16.254ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81512024-11-25T19:37:16.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81522024-11-25T19:37:16.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81532024-11-25T19:37:16.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81542024-11-25T19:37:16.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81552024-11-25T19:37:16.256ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81562024-11-25T19:37:16.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81572024-11-25T19:37:16.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
81582024-11-25T19:37:16.257ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
81592024-11-25T19:37:16.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
81602024-11-25T19:37:16.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81612024-11-25T19:37:16.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81622024-11-25T19:37:16.258ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81632024-11-25T19:37:16.258ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81642024-11-25T19:37:16.258ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81652024-11-25T19:37:16.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81662024-11-25T19:37:16.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81672024-11-25T19:37:16.259ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81682024-11-25T19:37:16.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81692024-11-25T19:37:16.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81702024-11-25T19:37:16.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81712024-11-25T19:37:16.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81722024-11-25T19:37:16.262ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81732024-11-25T19:37:16.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
81742024-11-25T19:37:16.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.776143ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
81752024-11-25T19:37:16.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81762024-11-25T19:37:16.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81772024-11-25T19:37:16.263ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81782024-11-25T19:37:16.263ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
81792024-11-25T19:37:16.263ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81802024-11-25T19:37:16.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81812024-11-25T19:37:16.265ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81822024-11-25T19:37:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
81832024-11-25T19:37:16.265ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81842024-11-25T19:37:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81852024-11-25T19:37:16.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81862024-11-25T19:37:16.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81872024-11-25T19:37:16.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81882024-11-25T19:37:16.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81892024-11-25T19:37:16.267ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81902024-11-25T19:37:16.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81912024-11-25T19:37:16.267ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81922024-11-25T19:37:16.268ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81932024-11-25T19:37:16.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.017085ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81942024-11-25T19:37:16.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81952024-11-25T19:37:16.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81962024-11-25T19:37:16.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81972024-11-25T19:37:16.269ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81982024-11-25T19:37:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81992024-11-25T19:37:16.270ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82002024-11-25T19:37:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82012024-11-25T19:37:16.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82022024-11-25T19:37:16.271ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82032024-11-25T19:37:16.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82042024-11-25T19:37:16.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
82052024-11-25T19:37:16.273ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82062024-11-25T19:37:16.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82072024-11-25T19:37:16.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82082024-11-25T19:37:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82092024-11-25T19:37:16.276ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 73.125855ms iteration = 4 status = {"nsuccess":5}
82102024-11-25T19:37:16.283ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
82112024-11-25T19:37:16.283ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.937028ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
82122024-11-25T19:37:16.283ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82132024-11-25T19:37:16.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82142024-11-25T19:37:16.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82152024-11-25T19:37:16.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
82162024-11-25T19:37:16.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82172024-11-25T19:37:16.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82182024-11-25T19:37:16.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.541865ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
82192024-11-25T19:37:16.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 95.950342ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
82202024-11-25T19:37:16.300ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
82212024-11-25T19:37:16.300ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
82222024-11-25T19:37:16.300ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82232024-11-25T19:37:16.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82242024-11-25T19:37:16.301ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
82252024-11-25T19:37:16.301ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
82262024-11-25T19:37:16.301ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
82272024-11-25T19:37:16.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82282024-11-25T19:37:16.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82292024-11-25T19:37:16.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82302024-11-25T19:37:16.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82312024-11-25T19:37:16.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82322024-11-25T19:37:16.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82332024-11-25T19:37:16.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82342024-11-25T19:37:16.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82352024-11-25T19:37:16.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82362024-11-25T19:37:16.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.713764ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82372024-11-25T19:37:16.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82382024-11-25T19:37:16.308ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
82392024-11-25T19:37:16.308ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
82402024-11-25T19:37:16.308ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
82412024-11-25T19:37:16.308ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 104.060522ms iteration = 8 status = {"generation":2}
82422024-11-25T19:37:16.308ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
82432024-11-25T19:37:16.308ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
82442024-11-25T19:37:16.308ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 104.714755ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
82452024-11-25T19:37:16.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82462024-11-25T19:37:16.316ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82472024-11-25T19:37:16.316ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
82482024-11-25T19:37:16.316ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 112.820613ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
82492024-11-25T19:37:16.316ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
82502024-11-25T19:37:16.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
82512024-11-25T19:37:16.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82522024-11-25T19:37:16.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82532024-11-25T19:37:16.320ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.71614ms iteration = 13 status = 0
82542024-11-25T19:37:16.325ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
82552024-11-25T19:37:16.326ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.506704ms iteration = 15 status = {"physical_disks_added":0}
82562024-11-25T19:37:16.327ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82572024-11-25T19:37:16.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82582024-11-25T19:37:16.329ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82592024-11-25T19:37:16.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
82602024-11-25T19:37:16.332ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82612024-11-25T19:37:16.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82622024-11-25T19:37:16.339ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
82632024-11-25T19:37:16.339ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
82642024-11-25T19:37:16.339ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82652024-11-25T19:37:16.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82662024-11-25T19:37:16.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82672024-11-25T19:37:16.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82682024-11-25T19:37:16.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82692024-11-25T19:37:16.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82702024-11-25T19:37:16.345ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
82712024-11-25T19:37:16.345ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
82722024-11-25T19:37:16.345ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
82732024-11-25T19:37:16.345ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 141.398364ms iteration = 8 status = {"generation":1}
82742024-11-25T19:37:16.346ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
82752024-11-25T19:37:16.346ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 142.157299ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
82762024-11-25T19:37:16.352ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
82772024-11-25T19:37:16.352ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82782024-11-25T19:37:16.352ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed2f9722-a733-497d-94a8-4f1f6f48f288", "content-length": "26", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
82792024-11-25T19:37:16.352ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82802024-11-25T19:37:16.354ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82812024-11-25T19:37:16.354ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
82822024-11-25T19:37:16.354ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82832024-11-25T19:37:16.354ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b9f710a-1dad-4d50-874b-435160af75c5", "content-length": "26", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
82842024-11-25T19:37:16.354ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82852024-11-25T19:37:16.356ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82862024-11-25T19:37:16.365ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
82872024-11-25T19:37:16.365ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82882024-11-25T19:37:16.366ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ab7efa3-bebd-444d-963c-06dc7b377c03", "content-length": "26", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
82892024-11-25T19:37:16.366ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82902024-11-25T19:37:16.367ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
82912024-11-25T19:37:16.371ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
82922024-11-25T19:37:16.371ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 167.544198ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
82932024-11-25T19:37:16.378ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82942024-11-25T19:37:16.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82952024-11-25T19:37:16.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82962024-11-25T19:37:16.382ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82972024-11-25T19:37:16.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82982024-11-25T19:37:16.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82992024-11-25T19:37:16.492ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
83002024-11-25T19:37:16.492ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5d8237c1-f5a4-4e52-9f04-ab00f5dbfa7b", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83012024-11-25T19:37:16.492ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83022024-11-25T19:37:16.493ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "604cb184-b08a-42cb-8ce0-f78fb377c564", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83032024-11-25T19:37:16.493ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83042024-11-25T19:37:16.495ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83052024-11-25T19:37:16.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 291.391708ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
83062024-11-25T19:37:16.528ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
83072024-11-25T19:37:16.528ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2ca7766-09cd-4354-b7b1-49c4ff06ab53", "content-length": "1", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
83082024-11-25T19:37:16.530ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83092024-11-25T19:37:16.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83102024-11-25T19:37:16.598ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
83112024-11-25T19:37:16.627ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 422.923867ms iteration = 13 status = {}
83122024-11-25T19:37:16.638ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
83132024-11-25T19:37:16.638ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83142024-11-25T19:37:16.638ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "938600af-64c9-426e-a517-f9f0ae325aa3", "content-length": "372", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
83152024-11-25T19:37:16.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83162024-11-25T19:37:16.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83172024-11-25T19:37:16.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83182024-11-25T19:37:16.641ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 437.246839ms iteration = 13 status = null
83192024-11-25T19:37:16.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83202024-11-25T19:37:16.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83212024-11-25T19:37:16.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83222024-11-25T19:37:16.677ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
83232024-11-25T19:37:16.677ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83242024-11-25T19:37:16.677ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "08d64cf0-c21d-4364-aa5c-525efded2e7c", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
83252024-11-25T19:37:16.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83262024-11-25T19:37:16.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83272024-11-25T19:37:16.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83282024-11-25T19:37:16.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83292024-11-25T19:37:16.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83302024-11-25T19:37:16.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83312024-11-25T19:37:16.686ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
83322024-11-25T19:37:16.686ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83332024-11-25T19:37:16.686ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dedea9bc-49e1-4bf3-8ddb-40878580a076", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
83342024-11-25T19:37:16.688ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 485.014186ms iteration = 14 status = {}
83352024-11-25T19:37:16.813ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
83362024-11-25T19:37:16.813ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "226d0fcf-910c-47eb-9009-2cd74de56553", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83372024-11-25T19:37:16.813ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83382024-11-25T19:37:16.815ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6b3e514f-75a6-4e28-97dc-51b9bb2afa00", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83392024-11-25T19:37:16.815ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83402024-11-25T19:37:16.816ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "21b61d57-d4d0-4ac9-bba7-7f6acc8e7bfc", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83412024-11-25T19:37:16.816ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83422024-11-25T19:37:16.818ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
83432024-11-25T19:37:16.818ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 614.15486ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
83442024-11-25T19:37:16.826ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
83452024-11-25T19:37:16.826ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b79ebbc-e19e-488d-80c6-0a0b7feaca08", "content-length": "691", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
83462024-11-25T19:37:16.826ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
83472024-11-25T19:37:16.826ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
83482024-11-25T19:37:16.826ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
83492024-11-25T19:37:16.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83502024-11-25T19:37:16.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83512024-11-25T19:37:16.828ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 624.408431ms iteration = 13 status = {}
83522024-11-25T19:37:16.828ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
83532024-11-25T19:37:16.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83542024-11-25T19:37:16.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83552024-11-25T19:37:16.838ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
83562024-11-25T19:37:16.838ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c7ec17b-2632-4585-affb-75774b0cb8b1", "content-length": "134", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
83572024-11-25T19:37:16.838ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
83582024-11-25T19:37:16.838ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
83592024-11-25T19:37:16.838ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
83602024-11-25T19:37:16.838ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
83612024-11-25T19:37:16.838ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83622024-11-25T19:37:16.838ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83632024-11-25T19:37:16.838ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83642024-11-25T19:37:16.838ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83652024-11-25T19:37:16.838ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83662024-11-25T19:37:16.838ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83672024-11-25T19:37:16.839ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
83682024-11-25T19:37:16.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83692024-11-25T19:37:16.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83702024-11-25T19:37:16.841ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
83712024-11-25T19:37:16.841ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "59798730-82f6-4c9d-ae22-1952772289a0", "content-length": "2", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
83722024-11-25T19:37:16.841ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
83732024-11-25T19:37:16.841ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eeb22c84-43b6-4dbc-9178-36cc0494bcee", "content-length": "51", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
83742024-11-25T19:37:16.841ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
83752024-11-25T19:37:16.841ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
83762024-11-25T19:37:16.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "349aab20-d1a2-416a-ac1d-3a5f766d846d", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
83772024-11-25T19:37:16.974ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
83782024-11-25T19:37:16.974ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
83792024-11-25T19:37:16.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2405b8c-a694-4301-92f6-167287e9de77", "content-length": "682", "date": "Mon, 25 Nov 2024 19:37:16 GMT"} })
83802024-11-25T19:37:16.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83812024-11-25T19:37:16.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83822024-11-25T19:37:16.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83832024-11-25T19:37:16.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83842024-11-25T19:37:16.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83852024-11-25T19:37:16.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83862024-11-25T19:37:16.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83872024-11-25T19:37:16.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83882024-11-25T19:37:16.993ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 789.678013ms iteration = 13 status = {}
83892024-11-25T19:37:17.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1335 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = a55bcbc2-3d83-48b5-8168-f23637c28356 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
83902024-11-25T19:37:17.744ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:58412
83912024-11-25T19:37:17.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58412 req_id = 38cfe766-207c-49a6-9027-61b207f407e4 roles = RoleSet { roles: {} } uri = /metrics/producers
83922024-11-25T19:37:17.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58412 req_id = 38cfe766-207c-49a6-9027-61b207f407e4 resource = Database result = Ok(()) uri = /metrics/producers
83932024-11-25T19:37:17.753ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = d2d29ac8-9dfa-4f1f-be62-a88a71a6b2fa
83942024-11-25T19:37:17.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8577 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58412 req_id = 38cfe766-207c-49a6-9027-61b207f407e4 response_code = 201 uri = /metrics/producers
83952024-11-25T19:37:23.660ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:40599
83962024-11-25T19:37:23.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40599 req_id = 55fe44ac-d053-4638-92a7-4f64ccef9495 roles = RoleSet { roles: {} } uri = /metrics/producers
83972024-11-25T19:37:23.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40599 req_id = 55fe44ac-d053-4638-92a7-4f64ccef9495 resource = Database result = Ok(()) uri = /metrics/producers
83982024-11-25T19:37:23.700ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 4626c149-3efd-47ab-bfa7-bdd3e9545fef
83992024-11-25T19:37:23.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39148 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40599 req_id = 55fe44ac-d053-4638-92a7-4f64ccef9495 response_code = 201 uri = /metrics/producers
84002024-11-25T19:37:26.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
84012024-11-25T19:37:26.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
84022024-11-25T19:37:26.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84032024-11-25T19:37:26.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84042024-11-25T19:37:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84052024-11-25T19:37:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84062024-11-25T19:37:26.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84072024-11-25T19:37:26.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84082024-11-25T19:37:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84092024-11-25T19:37:26.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.532319ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84102024-11-25T19:37:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84112024-11-25T19:37:26.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84122024-11-25T19:37:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84132024-11-25T19:37:26.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84142024-11-25T19:37:26.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84152024-11-25T19:37:26.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84162024-11-25T19:37:26.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
84172024-11-25T19:37:26.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84182024-11-25T19:37:26.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84192024-11-25T19:37:26.221ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
84202024-11-25T19:37:26.221ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.631395ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
84212024-11-25T19:37:27.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1286 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 3ecbf787-331e-40a7-9ab3-8129a0558f62 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
84222024-11-25T19:37:36.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
84232024-11-25T19:37:36.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
84242024-11-25T19:37:36.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84252024-11-25T19:37:36.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84262024-11-25T19:37:36.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84272024-11-25T19:37:36.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84282024-11-25T19:37:36.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84292024-11-25T19:37:36.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84302024-11-25T19:37:36.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84312024-11-25T19:37:36.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.917357ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84322024-11-25T19:37:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84332024-11-25T19:37:36.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84342024-11-25T19:37:36.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84352024-11-25T19:37:36.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84362024-11-25T19:37:36.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84372024-11-25T19:37:36.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84382024-11-25T19:37:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
84392024-11-25T19:37:36.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84402024-11-25T19:37:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84412024-11-25T19:37:36.223ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
84422024-11-25T19:37:36.223ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.721477ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
84432024-11-25T19:37:37.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 11847f68-7ad2-4d34-84f2-6414474ecdde roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
84442024-11-25T19:37:37.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 11847f68-7ad2-4d34-84f2-6414474ecdde resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
84452024-11-25T19:37:37.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 11847f68-7ad2-4d34-84f2-6414474ecdde response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
84462024-11-25T19:37:37.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 05f85291-2b92-4ab4-b944-16e0d6e1ef8f roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
84472024-11-25T19:37:37.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 05f85291-2b92-4ab4-b944-16e0d6e1ef8f resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
84482024-11-25T19:37:37.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 05f85291-2b92-4ab4-b944-16e0d6e1ef8f response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
84492024-11-25T19:37:37.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1101 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = b73ad436-508e-4bb0-864a-a1b7388076d5 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
84502024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
84512024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
84522024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84532024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84542024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
84552024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
84562024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84572024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
84582024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84592024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84602024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
84612024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84622024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84632024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
84642024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84652024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
84662024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84672024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
84682024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84692024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
84702024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
84712024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
84722024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
84732024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
84742024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
84752024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84762024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
84772024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
84782024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84792024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84802024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
84812024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84822024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
84832024-11-25T19:37:46.203ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84842024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84852024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84862024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84872024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84882024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84892024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84902024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84912024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84922024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84932024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84942024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84952024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84962024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84972024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84982024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84992024-11-25T19:37:46.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85002024-11-25T19:37:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85012024-11-25T19:37:46.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85022024-11-25T19:37:46.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85032024-11-25T19:37:46.206ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.463678ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85042024-11-25T19:37:46.207ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85052024-11-25T19:37:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85062024-11-25T19:37:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85072024-11-25T19:37:46.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85082024-11-25T19:37:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85092024-11-25T19:37:46.207ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85102024-11-25T19:37:46.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85112024-11-25T19:37:46.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85122024-11-25T19:37:46.209ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85132024-11-25T19:37:46.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85142024-11-25T19:37:46.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1491, tv_nsec: 756306015 } })
85152024-11-25T19:37:46.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1491, tv_nsec: 756466698 } })
85162024-11-25T19:37:46.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
85172024-11-25T19:37:46.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
85182024-11-25T19:37:46.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85192024-11-25T19:37:46.211ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85202024-11-25T19:37:46.211ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.20012ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
85212024-11-25T19:37:46.212ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85222024-11-25T19:37:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85232024-11-25T19:37:46.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85242024-11-25T19:37:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85252024-11-25T19:37:46.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85262024-11-25T19:37:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85272024-11-25T19:37:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85282024-11-25T19:37:46.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85292024-11-25T19:37:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85302024-11-25T19:37:46.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85312024-11-25T19:37:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85322024-11-25T19:37:46.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85332024-11-25T19:37:46.217ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85342024-11-25T19:37:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85352024-11-25T19:37:46.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85362024-11-25T19:37:46.217ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.502805ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85372024-11-25T19:37:46.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 15.536405ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85382024-11-25T19:37:46.219ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1491, tv_nsec: 764807542 } })
85392024-11-25T19:37:46.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
85402024-11-25T19:37:46.219ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85412024-11-25T19:37:46.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85422024-11-25T19:37:46.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85432024-11-25T19:37:46.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85442024-11-25T19:37:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85452024-11-25T19:37:46.221ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85462024-11-25T19:37:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85472024-11-25T19:37:46.222ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85482024-11-25T19:37:46.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85492024-11-25T19:37:46.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85502024-11-25T19:37:46.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85512024-11-25T19:37:46.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85522024-11-25T19:37:46.223ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85532024-11-25T19:37:46.223ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.148315ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
85542024-11-25T19:37:46.223ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85552024-11-25T19:37:46.224ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 20.737307ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
85562024-11-25T19:37:46.224ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85572024-11-25T19:37:46.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85582024-11-25T19:37:46.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85592024-11-25T19:37:46.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85602024-11-25T19:37:46.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85612024-11-25T19:37:46.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85622024-11-25T19:37:46.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85632024-11-25T19:37:46.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85642024-11-25T19:37:46.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85652024-11-25T19:37:46.237ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85662024-11-25T19:37:46.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85672024-11-25T19:37:46.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85682024-11-25T19:37:46.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85692024-11-25T19:37:46.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85702024-11-25T19:37:46.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85712024-11-25T19:37:46.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85722024-11-25T19:37:46.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.051826ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
85732024-11-25T19:37:46.241ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85742024-11-25T19:37:46.241ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85752024-11-25T19:37:46.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85762024-11-25T19:37:46.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85772024-11-25T19:37:46.246ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85782024-11-25T19:37:46.246ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85792024-11-25T19:37:46.246ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85802024-11-25T19:37:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85812024-11-25T19:37:46.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85822024-11-25T19:37:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85832024-11-25T19:37:46.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85842024-11-25T19:37:46.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85852024-11-25T19:37:46.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85862024-11-25T19:37:46.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
85872024-11-25T19:37:46.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85882024-11-25T19:37:46.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85892024-11-25T19:37:46.256ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85902024-11-25T19:37:46.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85912024-11-25T19:37:46.256ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 53.229484ms iteration = 14 status = 0
85922024-11-25T19:37:46.257ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.662872ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
85932024-11-25T19:37:46.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85942024-11-25T19:37:46.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
85952024-11-25T19:37:46.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85962024-11-25T19:37:46.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85972024-11-25T19:37:46.276ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
85982024-11-25T19:37:46.276ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.750237ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
85992024-11-25T19:37:46.282ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86002024-11-25T19:37:46.282ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86012024-11-25T19:37:46.282ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 79.557081ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86022024-11-25T19:37:46.317ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 114.373854ms iteration = 16 status = {"physical_disks_added":0}
86032024-11-25T19:37:46.338ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86042024-11-25T19:37:46.338ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86052024-11-25T19:37:46.338ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b77aa0c-0a73-455c-97e3-4a663c961cba", "content-length": "26", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
86062024-11-25T19:37:46.338ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86072024-11-25T19:37:46.340ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86082024-11-25T19:37:46.348ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
86092024-11-25T19:37:46.348ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86102024-11-25T19:37:46.348ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6775a0e8-db96-42ca-9d6f-654e21841ccc", "content-length": "26", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
86112024-11-25T19:37:46.348ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86122024-11-25T19:37:46.348ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86132024-11-25T19:37:46.348ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86142024-11-25T19:37:46.348ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c13220c-2838-4fe6-99d9-28bf1b4f77eb", "content-length": "26", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
86152024-11-25T19:37:46.348ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86162024-11-25T19:37:46.352ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
86172024-11-25T19:37:46.352ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86182024-11-25T19:37:46.370ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86192024-11-25T19:37:46.371ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "014f937f-7146-47b4-bea9-0bf7700cf3d5", "content-length": "691", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
86202024-11-25T19:37:46.371ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
86212024-11-25T19:37:46.371ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
86222024-11-25T19:37:46.371ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
86232024-11-25T19:37:46.372ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 168.996266ms iteration = 14 status = {}
86242024-11-25T19:37:46.440ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86252024-11-25T19:37:46.440ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86262024-11-25T19:37:46.440ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "49d354fc-5b85-4420-a5ac-5a5fc7cdb7ed", "content-length": "372", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
86272024-11-25T19:37:46.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86282024-11-25T19:37:46.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86292024-11-25T19:37:46.454ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 251.128888ms iteration = 14 status = {}
86302024-11-25T19:37:46.454ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
86312024-11-25T19:37:46.454ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86322024-11-25T19:37:46.454ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a1ecb4bb-6e69-4735-a83b-3dc170eb54df", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
86332024-11-25T19:37:46.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86342024-11-25T19:37:46.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86352024-11-25T19:37:46.457ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86362024-11-25T19:37:46.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86372024-11-25T19:37:46.457ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86382024-11-25T19:37:46.458ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "92ccf569-3e9a-46c1-b800-3c2eeb73bac4", "content-length": "1", "date": "Mon, 25 Nov 2024 19:37:45 GMT"} })
86392024-11-25T19:37:46.459ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86402024-11-25T19:37:46.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86412024-11-25T19:37:46.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86422024-11-25T19:37:46.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86432024-11-25T19:37:46.461ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 257.756997ms iteration = 14 status = null
86442024-11-25T19:37:46.462ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
86452024-11-25T19:37:46.462ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86462024-11-25T19:37:46.463ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bf02fc5b-bf4a-4888-a04d-6c21f4bfa01c", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
86472024-11-25T19:37:46.464ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 261.052372ms iteration = 15 status = {}
86482024-11-25T19:37:46.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86492024-11-25T19:37:46.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86502024-11-25T19:37:46.519ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
86512024-11-25T19:37:46.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86522024-11-25T19:37:46.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86532024-11-25T19:37:46.527ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
86542024-11-25T19:37:46.527ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8678b8e-336a-4818-a203-828a315e8ee9", "content-length": "134", "date": "Mon, 25 Nov 2024 19:37:45 GMT"} })
86552024-11-25T19:37:46.527ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
86562024-11-25T19:37:46.527ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
86572024-11-25T19:37:46.528ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
86582024-11-25T19:37:46.528ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
86592024-11-25T19:37:46.528ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86602024-11-25T19:37:46.528ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86612024-11-25T19:37:46.528ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86622024-11-25T19:37:46.528ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86632024-11-25T19:37:46.528ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86642024-11-25T19:37:46.528ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86652024-11-25T19:37:46.528ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
86662024-11-25T19:37:46.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86672024-11-25T19:37:46.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86682024-11-25T19:37:46.530ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
86692024-11-25T19:37:46.530ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ac16cfb-fad0-487f-988f-1a0af299e065", "content-length": "2", "date": "Mon, 25 Nov 2024 19:37:45 GMT"} })
86702024-11-25T19:37:46.530ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
86712024-11-25T19:37:46.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "351f6eec-bc7b-4a0f-8521-c8ef6272955a", "content-length": "51", "date": "Mon, 25 Nov 2024 19:37:45 GMT"} })
86722024-11-25T19:37:46.531ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
86732024-11-25T19:37:46.531ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
86742024-11-25T19:37:46.616ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5b7ff7ce-9803-4a6c-a0bc-9ac7383d98bc", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
86752024-11-25T19:37:46.616ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
86762024-11-25T19:37:46.616ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86772024-11-25T19:37:46.616ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3fb74a1-4370-469d-a005-a56ec839b139", "content-length": "682", "date": "Mon, 25 Nov 2024 19:37:46 GMT"} })
86782024-11-25T19:37:46.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86792024-11-25T19:37:46.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86802024-11-25T19:37:46.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86812024-11-25T19:37:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86822024-11-25T19:37:46.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86832024-11-25T19:37:46.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86842024-11-25T19:37:46.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86852024-11-25T19:37:46.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86862024-11-25T19:37:46.634ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 431.16074ms iteration = 14 status = {}
86872024-11-25T19:37:47.290ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1113 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 55e253cc-7632-42d3-a22a-0162f19ec6d7 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
86882024-11-25T19:37:56.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
86892024-11-25T19:37:56.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
86902024-11-25T19:37:56.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86912024-11-25T19:37:56.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86922024-11-25T19:37:56.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86932024-11-25T19:37:56.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86942024-11-25T19:37:56.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86952024-11-25T19:37:56.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86962024-11-25T19:37:56.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86972024-11-25T19:37:56.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.070749ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86982024-11-25T19:37:56.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86992024-11-25T19:37:56.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87002024-11-25T19:37:56.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87012024-11-25T19:37:56.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87022024-11-25T19:37:56.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87032024-11-25T19:37:56.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87042024-11-25T19:37:56.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
87052024-11-25T19:37:56.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87062024-11-25T19:37:56.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87072024-11-25T19:37:56.223ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
87082024-11-25T19:37:56.223ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.665306ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
87092024-11-25T19:37:57.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1201 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = ae0717b2-7545-4e4d-b70e-5cdcf0e46e54 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
87102024-11-25T19:38:06.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
87112024-11-25T19:38:06.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
87122024-11-25T19:38:06.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87132024-11-25T19:38:06.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87142024-11-25T19:38:06.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87152024-11-25T19:38:06.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87162024-11-25T19:38:06.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87172024-11-25T19:38:06.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87182024-11-25T19:38:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87192024-11-25T19:38:06.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.231043ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87202024-11-25T19:38:06.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87212024-11-25T19:38:06.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87222024-11-25T19:38:06.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87232024-11-25T19:38:06.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87242024-11-25T19:38:06.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87252024-11-25T19:38:06.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87262024-11-25T19:38:06.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
87272024-11-25T19:38:06.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87282024-11-25T19:38:06.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87292024-11-25T19:38:06.223ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
87302024-11-25T19:38:06.223ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.144305ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
87312024-11-25T19:38:07.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1138 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 55a21e80-b3e6-4867-a33a-70fcb1a93fc2 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
87322024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
87332024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87342024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
87352024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87362024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
87372024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87382024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
87392024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
87402024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87412024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87422024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
87432024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87442024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
87452024-11-25T19:38:16.203ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87462024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87472024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
87482024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
87492024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87502024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87512024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
87522024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
87532024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87542024-11-25T19:38:16.203ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
87552024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87562024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
87572024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87582024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
87592024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87602024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87612024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
87622024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87632024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
87642024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87652024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
87662024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
87672024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87682024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
87692024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
87702024-11-25T19:38:16.204ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:28:16.203952231 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
87712024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
87722024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
87732024-11-25T19:38:16.204ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
87742024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
87752024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.99\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
87762024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
87772024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87782024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
87792024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
87802024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87812024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
87822024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
87832024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
87842024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
87852024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87862024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
87872024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87882024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
87892024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87902024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
87912024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
87922024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87932024-11-25T19:38:16.204ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
87942024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87952024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87962024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87972024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87982024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87992024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88002024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88012024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88022024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88032024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88042024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
88052024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88062024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88072024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88082024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88092024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88102024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88112024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88122024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
88132024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88142024-11-25T19:38:16.204ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1521, tv_nsec: 750046452 } })
88152024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88162024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88172024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
88182024-11-25T19:38:16.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88192024-11-25T19:38:16.204ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1521, tv_nsec: 750178924 } })
88202024-11-25T19:38:16.205ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
88212024-11-25T19:38:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.066291ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
88222024-11-25T19:38:16.205ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
88232024-11-25T19:38:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.221434ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
88242024-11-25T19:38:16.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88252024-11-25T19:38:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88262024-11-25T19:38:16.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88272024-11-25T19:38:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88282024-11-25T19:38:16.207ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1521, tv_nsec: 753176933 } })
88292024-11-25T19:38:16.208ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
88302024-11-25T19:38:16.208ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.393516ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88312024-11-25T19:38:16.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88322024-11-25T19:38:16.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1521, tv_nsec: 756003589 } })
88332024-11-25T19:38:16.210ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88342024-11-25T19:38:16.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
88352024-11-25T19:38:16.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88362024-11-25T19:38:16.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88372024-11-25T19:38:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88382024-11-25T19:38:16.211ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.453587ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
88392024-11-25T19:38:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88402024-11-25T19:38:16.212ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88412024-11-25T19:38:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88422024-11-25T19:38:16.213ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88432024-11-25T19:38:16.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88442024-11-25T19:38:16.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88452024-11-25T19:38:16.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88462024-11-25T19:38:16.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88472024-11-25T19:38:16.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88482024-11-25T19:38:16.215ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88492024-11-25T19:38:16.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88502024-11-25T19:38:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88512024-11-25T19:38:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88522024-11-25T19:38:16.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88532024-11-25T19:38:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88542024-11-25T19:38:16.216ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88552024-11-25T19:38:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88562024-11-25T19:38:16.217ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:28:16.203952231 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
88572024-11-25T19:38:16.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88582024-11-25T19:38:16.217ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.799531ms iteration = 8 status = {"expiration":"2024-11-25T19:28:16.203952231Z","pruned":[]}
88592024-11-25T19:38:16.218ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88602024-11-25T19:38:16.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88612024-11-25T19:38:16.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88622024-11-25T19:38:16.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88632024-11-25T19:38:16.219ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.238519ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
88642024-11-25T19:38:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88652024-11-25T19:38:16.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88662024-11-25T19:38:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88672024-11-25T19:38:16.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
88682024-11-25T19:38:16.221ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
88692024-11-25T19:38:16.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88702024-11-25T19:38:16.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88712024-11-25T19:38:16.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88722024-11-25T19:38:16.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88732024-11-25T19:38:16.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88742024-11-25T19:38:16.223ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88752024-11-25T19:38:16.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88762024-11-25T19:38:16.223ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1521, tv_nsec: 769270379 } })
88772024-11-25T19:38:16.224ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
88782024-11-25T19:38:16.225ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88792024-11-25T19:38:16.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88802024-11-25T19:38:16.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88812024-11-25T19:38:16.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88822024-11-25T19:38:16.227ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
88832024-11-25T19:38:16.227ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 23.160604ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
88842024-11-25T19:38:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88852024-11-25T19:38:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88862024-11-25T19:38:16.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88872024-11-25T19:38:16.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88882024-11-25T19:38:16.230ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88892024-11-25T19:38:16.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88902024-11-25T19:38:16.230ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88912024-11-25T19:38:16.230ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.659643ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88922024-11-25T19:38:16.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88932024-11-25T19:38:16.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88942024-11-25T19:38:16.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88952024-11-25T19:38:16.235ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88962024-11-25T19:38:16.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88972024-11-25T19:38:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
88982024-11-25T19:38:16.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88992024-11-25T19:38:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89002024-11-25T19:38:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
89012024-11-25T19:38:16.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89022024-11-25T19:38:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89032024-11-25T19:38:16.245ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89042024-11-25T19:38:16.245ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89052024-11-25T19:38:16.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89062024-11-25T19:38:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89072024-11-25T19:38:16.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.960342ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
89082024-11-25T19:38:16.253ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
89092024-11-25T19:38:16.253ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
89102024-11-25T19:38:16.253ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
89112024-11-25T19:38:16.253ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 49.752046ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
89122024-11-25T19:38:16.253ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.525242ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
89132024-11-25T19:38:16.255ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89142024-11-25T19:38:16.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89152024-11-25T19:38:16.255ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89162024-11-25T19:38:16.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89172024-11-25T19:38:16.257ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 53.496979ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
89182024-11-25T19:38:16.258ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.588731ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89192024-11-25T19:38:16.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89202024-11-25T19:38:16.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89212024-11-25T19:38:16.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89222024-11-25T19:38:16.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89232024-11-25T19:38:16.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89242024-11-25T19:38:16.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89252024-11-25T19:38:16.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89262024-11-25T19:38:16.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89272024-11-25T19:38:16.271ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89282024-11-25T19:38:16.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89292024-11-25T19:38:16.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
89302024-11-25T19:38:16.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89312024-11-25T19:38:16.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89322024-11-25T19:38:16.272ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
89332024-11-25T19:38:16.272ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
89342024-11-25T19:38:16.272ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 68.600656ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
89352024-11-25T19:38:16.273ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89362024-11-25T19:38:16.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89372024-11-25T19:38:16.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89382024-11-25T19:38:16.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89392024-11-25T19:38:16.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89402024-11-25T19:38:16.274ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.096695ms iteration = 15 status = 0
89412024-11-25T19:38:16.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.024863ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89422024-11-25T19:38:16.278ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
89432024-11-25T19:38:16.278ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
89442024-11-25T19:38:16.278ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
89452024-11-25T19:38:16.278ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89462024-11-25T19:38:16.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89472024-11-25T19:38:16.279ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
89482024-11-25T19:38:16.279ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
89492024-11-25T19:38:16.279ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
89502024-11-25T19:38:16.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89512024-11-25T19:38:16.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89522024-11-25T19:38:16.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89532024-11-25T19:38:16.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89542024-11-25T19:38:16.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89552024-11-25T19:38:16.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89562024-11-25T19:38:16.283ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89572024-11-25T19:38:16.283ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89582024-11-25T19:38:16.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89592024-11-25T19:38:16.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89602024-11-25T19:38:16.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89612024-11-25T19:38:16.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89622024-11-25T19:38:16.294ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 91.298061ms iteration = 17 status = {"physical_disks_added":0}
89632024-11-25T19:38:16.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.693005ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
89642024-11-25T19:38:16.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89652024-11-25T19:38:16.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89662024-11-25T19:38:16.389ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
89672024-11-25T19:38:16.393ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89682024-11-25T19:38:16.393ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89692024-11-25T19:38:16.393ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e7ee0ca-c7b8-4982-b046-a3de58fb68c3", "content-length": "26", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
89702024-11-25T19:38:16.393ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89712024-11-25T19:38:16.395ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89722024-11-25T19:38:16.404ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
89732024-11-25T19:38:16.404ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89742024-11-25T19:38:16.404ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "71ddfe02-8b12-4e44-89e8-3bd3461177c1", "content-length": "26", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
89752024-11-25T19:38:16.404ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89762024-11-25T19:38:16.406ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
89772024-11-25T19:38:16.452ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89782024-11-25T19:38:16.452ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89792024-11-25T19:38:16.453ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c39c626-6805-476e-97bc-7b57063c3795", "content-length": "372", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
89802024-11-25T19:38:16.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89812024-11-25T19:38:16.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89822024-11-25T19:38:16.454ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89832024-11-25T19:38:16.456ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89842024-11-25T19:38:16.456ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89852024-11-25T19:38:16.456ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89862024-11-25T19:38:16.456ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89872024-11-25T19:38:16.456ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 252.214509ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
89882024-11-25T19:38:16.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89892024-11-25T19:38:16.457ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89902024-11-25T19:38:16.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89912024-11-25T19:38:16.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89922024-11-25T19:38:16.458ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89932024-11-25T19:38:16.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89942024-11-25T19:38:16.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89952024-11-25T19:38:16.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89962024-11-25T19:38:16.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89972024-11-25T19:38:16.483ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
89982024-11-25T19:38:16.485ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
89992024-11-25T19:38:16.485ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
90002024-11-25T19:38:16.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90012024-11-25T19:38:16.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90022024-11-25T19:38:16.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90032024-11-25T19:38:16.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90042024-11-25T19:38:16.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90052024-11-25T19:38:16.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90062024-11-25T19:38:16.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90072024-11-25T19:38:16.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90082024-11-25T19:38:16.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90092024-11-25T19:38:16.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90102024-11-25T19:38:16.492ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
90112024-11-25T19:38:16.492ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
90122024-11-25T19:38:16.492ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
90132024-11-25T19:38:16.492ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 288.835147ms iteration = 9 status = {"generation":2}
90142024-11-25T19:38:16.494ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
90152024-11-25T19:38:16.494ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
90162024-11-25T19:38:16.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90172024-11-25T19:38:16.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90182024-11-25T19:38:16.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90192024-11-25T19:38:16.496ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
90202024-11-25T19:38:16.496ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90212024-11-25T19:38:16.496ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7493ea8a-311c-4f36-a29f-3d2a6226d85e", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
90222024-11-25T19:38:16.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90232024-11-25T19:38:16.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90242024-11-25T19:38:16.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90252024-11-25T19:38:16.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90262024-11-25T19:38:16.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90272024-11-25T19:38:16.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90282024-11-25T19:38:16.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90292024-11-25T19:38:16.501ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
90302024-11-25T19:38:16.501ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
90312024-11-25T19:38:16.501ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
90322024-11-25T19:38:16.501ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 297.515608ms iteration = 9 status = {"generation":1}
90332024-11-25T19:38:16.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90342024-11-25T19:38:16.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90352024-11-25T19:38:16.505ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90362024-11-25T19:38:16.505ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90372024-11-25T19:38:16.505ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6d457d55-c479-4ab5-a405-9a0b01f565cd", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
90382024-11-25T19:38:16.506ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
90392024-11-25T19:38:16.506ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 302.465524ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
90402024-11-25T19:38:16.512ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 308.3563ms iteration = 16 status = {}
90412024-11-25T19:38:16.519ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90422024-11-25T19:38:16.519ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90432024-11-25T19:38:16.519ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd0c274c-3467-422b-a314-7ca6a7b7207d", "content-length": "26", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
90442024-11-25T19:38:16.519ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90452024-11-25T19:38:16.521ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90462024-11-25T19:38:16.565ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90472024-11-25T19:38:16.566ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9e46411-6f4b-4b5a-b753-adbbfe886de4", "content-length": "1", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
90482024-11-25T19:38:16.567ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90492024-11-25T19:38:16.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90502024-11-25T19:38:16.586ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
90512024-11-25T19:38:16.586ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e064e893-34a4-4155-890e-1f9f514aa917", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90522024-11-25T19:38:16.586ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90532024-11-25T19:38:16.588ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "afa7317a-a35a-454e-995c-cb6db7bd1b8c", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90542024-11-25T19:38:16.588ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90552024-11-25T19:38:16.590ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90562024-11-25T19:38:16.590ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 386.506193ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
90572024-11-25T19:38:16.641ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
90582024-11-25T19:38:16.690ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 486.928774ms iteration = 15 status = {}
90592024-11-25T19:38:16.752ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
90602024-11-25T19:38:16.753ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4434046a-b5e3-40e0-992f-4844719b18aa", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90612024-11-25T19:38:16.753ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90622024-11-25T19:38:16.754ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1356d55a-61de-4024-8c79-567d2059ae69", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90632024-11-25T19:38:16.754ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90642024-11-25T19:38:16.755ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "76b43fc3-f332-4dff-8de8-8a931298cfc4", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90652024-11-25T19:38:16.755ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90662024-11-25T19:38:16.757ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
90672024-11-25T19:38:16.757ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 553.52984ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
90682024-11-25T19:38:16.774ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90692024-11-25T19:38:16.774ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bff2dcf8-f99b-4ed6-8ac4-0d5e214ff500", "content-length": "691", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
90702024-11-25T19:38:16.774ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
90712024-11-25T19:38:16.774ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
90722024-11-25T19:38:16.774ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
90732024-11-25T19:38:16.776ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 572.436191ms iteration = 15 status = null
90742024-11-25T19:38:16.776ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 572.926601ms iteration = 15 status = {}
90752024-11-25T19:38:16.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90762024-11-25T19:38:16.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90772024-11-25T19:38:16.812ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
90782024-11-25T19:38:16.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90792024-11-25T19:38:16.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90802024-11-25T19:38:16.821ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90812024-11-25T19:38:16.821ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "013c25bf-4273-4f2a-8205-b4ba249848bd", "content-length": "134", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
90822024-11-25T19:38:16.821ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90832024-11-25T19:38:16.821ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
90842024-11-25T19:38:16.821ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90852024-11-25T19:38:16.821ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90862024-11-25T19:38:16.821ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90872024-11-25T19:38:16.821ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90882024-11-25T19:38:16.821ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90892024-11-25T19:38:16.821ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90902024-11-25T19:38:16.821ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90912024-11-25T19:38:16.821ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90922024-11-25T19:38:16.822ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
90932024-11-25T19:38:16.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90942024-11-25T19:38:16.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90952024-11-25T19:38:16.823ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90962024-11-25T19:38:16.823ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ede2c4b-c6f7-4bf4-bcb5-739615056cae", "content-length": "2", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
90972024-11-25T19:38:16.823ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90982024-11-25T19:38:16.823ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "06a1f1f0-f559-412c-b708-0dccfb99838e", "content-length": "51", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
90992024-11-25T19:38:16.823ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
91002024-11-25T19:38:16.823ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91012024-11-25T19:38:16.956ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0ee52470-77fa-4775-b603-5f4406c9ad38", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
91022024-11-25T19:38:16.956ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
91032024-11-25T19:38:16.956ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91042024-11-25T19:38:16.956ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb238c6a-6374-40ad-b2bb-07fa902a627a", "content-length": "682", "date": "Mon, 25 Nov 2024 19:38:16 GMT"} })
91052024-11-25T19:38:16.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91062024-11-25T19:38:16.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91072024-11-25T19:38:16.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91082024-11-25T19:38:16.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91092024-11-25T19:38:16.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91102024-11-25T19:38:16.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91112024-11-25T19:38:16.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91122024-11-25T19:38:16.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91132024-11-25T19:38:16.984ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 781.060424ms iteration = 15 status = {}
91142024-11-25T19:38:17.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1192 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = dac66241-7869-4d4b-8601-dade871f1a87 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
91152024-11-25T19:38:22.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = c8627f9d-8346-4b6e-a9df-af9113d3c072 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
91162024-11-25T19:38:22.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = c8627f9d-8346-4b6e-a9df-af9113d3c072 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
91172024-11-25T19:38:22.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = c8627f9d-8346-4b6e-a9df-af9113d3c072 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
91182024-11-25T19:38:22.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 96770236-692d-4566-a7a2-7609fee7aa04 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
91192024-11-25T19:38:22.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 96770236-692d-4566-a7a2-7609fee7aa04 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
91202024-11-25T19:38:22.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 96770236-692d-4566-a7a2-7609fee7aa04 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
91212024-11-25T19:38:26.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
91222024-11-25T19:38:26.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91232024-11-25T19:38:26.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
91242024-11-25T19:38:26.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91252024-11-25T19:38:26.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91262024-11-25T19:38:26.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91272024-11-25T19:38:26.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91282024-11-25T19:38:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91292024-11-25T19:38:26.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.504529ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91302024-11-25T19:38:26.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91312024-11-25T19:38:26.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91322024-11-25T19:38:26.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91332024-11-25T19:38:26.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91342024-11-25T19:38:26.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91352024-11-25T19:38:26.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91362024-11-25T19:38:26.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91372024-11-25T19:38:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
91382024-11-25T19:38:26.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91392024-11-25T19:38:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91402024-11-25T19:38:26.251ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
91412024-11-25T19:38:26.251ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.631164ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
91422024-11-25T19:38:27.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1113 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = b97dc216-afdd-431b-9b0f-1bd0f9ca3e92 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
91432024-11-25T19:38:36.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
91442024-11-25T19:38:36.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
91452024-11-25T19:38:36.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91462024-11-25T19:38:36.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91472024-11-25T19:38:36.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91482024-11-25T19:38:36.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91492024-11-25T19:38:36.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91502024-11-25T19:38:36.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91512024-11-25T19:38:36.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91522024-11-25T19:38:36.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91532024-11-25T19:38:36.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91542024-11-25T19:38:36.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91552024-11-25T19:38:36.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91562024-11-25T19:38:36.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91572024-11-25T19:38:36.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91582024-11-25T19:38:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
91592024-11-25T19:38:36.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91602024-11-25T19:38:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91612024-11-25T19:38:36.227ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
91622024-11-25T19:38:36.227ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.525302ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
91632024-11-25T19:38:36.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.674412ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91642024-11-25T19:38:37.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1350 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 2a0a57cc-f2bf-4a05-a354-2f4c5499bec6 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
91652024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
91662024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91672024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
91682024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91692024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
91702024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91712024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
91722024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
91732024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
91742024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91752024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91762024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
91772024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
91782024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
91792024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
91802024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91812024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
91822024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91832024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
91842024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
91852024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91862024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
91872024-11-25T19:38:46.203ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
91882024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
91892024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91902024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91912024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
91922024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91932024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
91942024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91952024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
91962024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
91972024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
91982024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
91992024-11-25T19:38:46.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92002024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92012024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92022024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92032024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92042024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92052024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92062024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92072024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92082024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92092024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92102024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92112024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92122024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92132024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92142024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92152024-11-25T19:38:46.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92162024-11-25T19:38:46.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92172024-11-25T19:38:46.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.325496ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
92182024-11-25T19:38:46.207ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.600521ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92192024-11-25T19:38:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92202024-11-25T19:38:46.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92212024-11-25T19:38:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92222024-11-25T19:38:46.208ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1551, tv_nsec: 753647892 } })
92232024-11-25T19:38:46.208ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
92242024-11-25T19:38:46.210ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92252024-11-25T19:38:46.210ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92262024-11-25T19:38:46.210ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
92272024-11-25T19:38:46.210ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92282024-11-25T19:38:46.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92292024-11-25T19:38:46.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92302024-11-25T19:38:46.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92312024-11-25T19:38:46.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1551, tv_nsec: 756624141 } })
92322024-11-25T19:38:46.211ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92332024-11-25T19:38:46.211ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
92342024-11-25T19:38:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
92352024-11-25T19:38:46.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92362024-11-25T19:38:46.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92372024-11-25T19:38:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92382024-11-25T19:38:46.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92392024-11-25T19:38:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92402024-11-25T19:38:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92412024-11-25T19:38:46.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92422024-11-25T19:38:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92432024-11-25T19:38:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92442024-11-25T19:38:46.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92452024-11-25T19:38:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92462024-11-25T19:38:46.219ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1551, tv_nsec: 763945694 } })
92472024-11-25T19:38:46.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
92482024-11-25T19:38:46.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92492024-11-25T19:38:46.221ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92502024-11-25T19:38:46.221ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92512024-11-25T19:38:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92522024-11-25T19:38:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92532024-11-25T19:38:46.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92542024-11-25T19:38:46.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92552024-11-25T19:38:46.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92562024-11-25T19:38:46.223ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92572024-11-25T19:38:46.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92582024-11-25T19:38:46.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92592024-11-25T19:38:46.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92602024-11-25T19:38:46.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92612024-11-25T19:38:46.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92622024-11-25T19:38:46.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.83919ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
92632024-11-25T19:38:46.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92642024-11-25T19:38:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92652024-11-25T19:38:46.250ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92662024-11-25T19:38:46.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92672024-11-25T19:38:46.250ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
92682024-11-25T19:38:46.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92692024-11-25T19:38:46.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92702024-11-25T19:38:46.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.162566ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92712024-11-25T19:38:46.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92722024-11-25T19:38:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92732024-11-25T19:38:46.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92742024-11-25T19:38:46.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92752024-11-25T19:38:46.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92762024-11-25T19:38:46.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92772024-11-25T19:38:46.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92782024-11-25T19:38:46.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92792024-11-25T19:38:46.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
92802024-11-25T19:38:46.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92812024-11-25T19:38:46.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92822024-11-25T19:38:46.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92832024-11-25T19:38:46.257ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92842024-11-25T19:38:46.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92852024-11-25T19:38:46.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
92862024-11-25T19:38:46.259ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92872024-11-25T19:38:46.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92882024-11-25T19:38:46.260ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92892024-11-25T19:38:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92902024-11-25T19:38:46.261ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.141181ms iteration = 16 status = 0
92912024-11-25T19:38:46.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
92922024-11-25T19:38:46.264ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.907095ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
92932024-11-25T19:38:46.266ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92942024-11-25T19:38:46.266ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
92952024-11-25T19:38:46.266ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.21373ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
92962024-11-25T19:38:46.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92972024-11-25T19:38:46.268ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92982024-11-25T19:38:46.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92992024-11-25T19:38:46.276ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.377971ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93002024-11-25T19:38:46.280ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93012024-11-25T19:38:46.280ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93022024-11-25T19:38:46.281ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d6265e2-2746-4a3b-aedf-a254cec238ff", "content-length": "26", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
93032024-11-25T19:38:46.281ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93042024-11-25T19:38:46.282ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93052024-11-25T19:38:46.292ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93062024-11-25T19:38:46.292ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93072024-11-25T19:38:46.292ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 89.125129ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93082024-11-25T19:38:46.296ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
93092024-11-25T19:38:46.296ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93102024-11-25T19:38:46.296ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb7ace1d-d688-4b72-8f4f-1682f1ca6846", "content-length": "26", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
93112024-11-25T19:38:46.296ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93122024-11-25T19:38:46.297ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 93.908092ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
93132024-11-25T19:38:46.298ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
93142024-11-25T19:38:46.302ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.36137ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93152024-11-25T19:38:46.305ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93162024-11-25T19:38:46.305ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93172024-11-25T19:38:46.306ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8434179e-422b-4163-bf65-1ee5fafdfcf8", "content-length": "26", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
93182024-11-25T19:38:46.306ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93192024-11-25T19:38:46.308ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93202024-11-25T19:38:46.316ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93212024-11-25T19:38:46.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93222024-11-25T19:38:46.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93232024-11-25T19:38:46.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93242024-11-25T19:38:46.353ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93252024-11-25T19:38:46.355ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93262024-11-25T19:38:46.355ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93272024-11-25T19:38:46.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93282024-11-25T19:38:46.357ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93292024-11-25T19:38:46.358ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93302024-11-25T19:38:46.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93312024-11-25T19:38:46.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93322024-11-25T19:38:46.366ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 162.706823ms iteration = 18 status = {"physical_disks_added":0}
93332024-11-25T19:38:46.381ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 178.097635ms iteration = 16 status = {}
93342024-11-25T19:38:46.409ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
93352024-11-25T19:38:46.409ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c63874d-fe69-4269-9485-3888cd628f34", "content-length": "1", "date": "Mon, 25 Nov 2024 19:38:45 GMT"} })
93362024-11-25T19:38:46.411ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93372024-11-25T19:38:46.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93382024-11-25T19:38:46.415ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93392024-11-25T19:38:46.415ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93402024-11-25T19:38:46.415ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "854c9e34-6be0-4cfd-8a70-70237b4b83d6", "content-length": "372", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
93412024-11-25T19:38:46.415ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93422024-11-25T19:38:46.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93432024-11-25T19:38:46.417ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 214.06982ms iteration = 16 status = null
93442024-11-25T19:38:46.460ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
93452024-11-25T19:38:46.460ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93462024-11-25T19:38:46.461ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f2c5a23e-d660-493c-8bd4-5ef311b34a4e", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
93472024-11-25T19:38:46.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93482024-11-25T19:38:46.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93492024-11-25T19:38:46.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93502024-11-25T19:38:46.463ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
93512024-11-25T19:38:46.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93522024-11-25T19:38:46.464ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb18a2ac-0375-4655-b320-e8500f83b719", "content-length": "691", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
93532024-11-25T19:38:46.464ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
93542024-11-25T19:38:46.464ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
93552024-11-25T19:38:46.464ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
93562024-11-25T19:38:46.464ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 261.280047ms iteration = 16 status = {}
93572024-11-25T19:38:46.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93582024-11-25T19:38:46.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93592024-11-25T19:38:46.469ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93602024-11-25T19:38:46.469ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93612024-11-25T19:38:46.470ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0a77655b-b175-4cbc-a233-4a9f957615ac", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
93622024-11-25T19:38:46.471ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 267.941477ms iteration = 17 status = {}
93632024-11-25T19:38:46.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93642024-11-25T19:38:46.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93652024-11-25T19:38:46.486ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
93662024-11-25T19:38:46.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93672024-11-25T19:38:46.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93682024-11-25T19:38:46.494ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93692024-11-25T19:38:46.495ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b9663c0-e585-4a57-a4b9-cb5502ebaa74", "content-length": "134", "date": "Mon, 25 Nov 2024 19:38:45 GMT"} })
93702024-11-25T19:38:46.495ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
93712024-11-25T19:38:46.495ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
93722024-11-25T19:38:46.495ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93732024-11-25T19:38:46.495ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93742024-11-25T19:38:46.495ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93752024-11-25T19:38:46.495ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93762024-11-25T19:38:46.495ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93772024-11-25T19:38:46.495ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93782024-11-25T19:38:46.495ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93792024-11-25T19:38:46.495ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93802024-11-25T19:38:46.496ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
93812024-11-25T19:38:46.496ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93822024-11-25T19:38:46.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93832024-11-25T19:38:46.497ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93842024-11-25T19:38:46.497ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bcdcd5e-d7a1-43c5-969e-2c48219b40a7", "content-length": "2", "date": "Mon, 25 Nov 2024 19:38:45 GMT"} })
93852024-11-25T19:38:46.497ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93862024-11-25T19:38:46.497ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6080cd31-8821-4270-90ab-0fdd6e27befa", "content-length": "51", "date": "Mon, 25 Nov 2024 19:38:45 GMT"} })
93872024-11-25T19:38:46.497ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
93882024-11-25T19:38:46.497ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93892024-11-25T19:38:46.590ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9f30ade8-bf14-432b-916c-34ae22951444", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
93902024-11-25T19:38:46.590ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
93912024-11-25T19:38:46.590ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93922024-11-25T19:38:46.593ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c643d747-56bd-466d-8615-250563dc16d6", "content-length": "682", "date": "Mon, 25 Nov 2024 19:38:46 GMT"} })
93932024-11-25T19:38:46.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93942024-11-25T19:38:46.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93952024-11-25T19:38:46.596ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93962024-11-25T19:38:46.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93972024-11-25T19:38:46.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93982024-11-25T19:38:46.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93992024-11-25T19:38:46.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94002024-11-25T19:38:46.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94012024-11-25T19:38:46.607ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 403.414335ms iteration = 16 status = {}
94022024-11-25T19:38:47.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1129 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = e909fe67-3745-4e35-af08-bffc5ee9dbd1 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
94032024-11-25T19:38:52.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 329b1780-30b7-4048-8e6a-adc3a3710949 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
94042024-11-25T19:38:52.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 329b1780-30b7-4048-8e6a-adc3a3710949 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
94052024-11-25T19:38:52.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 329b1780-30b7-4048-8e6a-adc3a3710949 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
94062024-11-25T19:38:52.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 831670fd-824d-46ee-8cdf-114a1bc7d72a roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
94072024-11-25T19:38:52.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 831670fd-824d-46ee-8cdf-114a1bc7d72a resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
94082024-11-25T19:38:52.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 831670fd-824d-46ee-8cdf-114a1bc7d72a response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
94092024-11-25T19:38:56.203ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
94102024-11-25T19:38:56.203ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94112024-11-25T19:38:56.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
94122024-11-25T19:38:56.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94132024-11-25T19:38:56.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94142024-11-25T19:38:56.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94152024-11-25T19:38:56.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94162024-11-25T19:38:56.207ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94172024-11-25T19:38:56.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94182024-11-25T19:38:56.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94192024-11-25T19:38:56.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94202024-11-25T19:38:56.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94212024-11-25T19:38:56.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94222024-11-25T19:38:56.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94232024-11-25T19:38:56.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94242024-11-25T19:38:56.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
94252024-11-25T19:38:56.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94262024-11-25T19:38:56.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94272024-11-25T19:38:56.223ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
94282024-11-25T19:38:56.223ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.699286ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
94292024-11-25T19:38:56.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.213053ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94302024-11-25T19:38:57.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1275 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 5bac7d7b-1206-4f43-ac75-adc020bd5b14 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
94312024-11-25T19:38:58.691ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:37499
94322024-11-25T19:38:58.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37499 req_id = 8386e59c-77a1-4c2f-a8ef-83e6d5c12221 roles = RoleSet { roles: {} } uri = /metrics/producers
94332024-11-25T19:38:58.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37499 req_id = 8386e59c-77a1-4c2f-a8ef-83e6d5c12221 resource = Database result = Ok(()) uri = /metrics/producers
94342024-11-25T19:38:58.742ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 38711855-ef69-4d79-bb75-aebd85b1280b
94352024-11-25T19:38:58.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51401 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37499 req_id = 8386e59c-77a1-4c2f-a8ef-83e6d5c12221 response_code = 201 uri = /metrics/producers
94362024-11-25T19:39:05.179ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
94372024-11-25T19:39:05.179ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
94382024-11-25T19:39:05.210ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
94392024-11-25T19:39:05.210ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:60775
94402024-11-25T19:39:05.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60775 req_id = d940d60e-a641-4dfd-8600-4820c490726f roles = RoleSet { roles: {} } uri = /metrics/producers
94412024-11-25T19:39:05.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60775 req_id = d940d60e-a641-4dfd-8600-4820c490726f resource = Database result = Ok(()) uri = /metrics/producers
94422024-11-25T19:39:05.250ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
94432024-11-25T19:39:05.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40097 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60775 req_id = d940d60e-a641-4dfd-8600-4820c490726f response_code = 201 uri = /metrics/producers
94442024-11-25T19:39:05.250ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d940d60e-a641-4dfd-8600-4820c490726f", "content-length": "41", "date": "Mon, 25 Nov 2024 19:39:05 GMT"} })
94452024-11-25T19:39:05.252ZDEBGnexus (producer-registration-task): registered with nexus successfully
94462024-11-25T19:39:05.252ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
94472024-11-25T19:39:06.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
94482024-11-25T19:39:06.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94492024-11-25T19:39:06.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
94502024-11-25T19:39:06.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94512024-11-25T19:39:06.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94522024-11-25T19:39:06.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94532024-11-25T19:39:06.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94542024-11-25T19:39:06.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94552024-11-25T19:39:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94562024-11-25T19:39:06.208ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.996908ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94572024-11-25T19:39:06.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94582024-11-25T19:39:06.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94592024-11-25T19:39:06.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94602024-11-25T19:39:06.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94612024-11-25T19:39:06.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94622024-11-25T19:39:06.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94632024-11-25T19:39:06.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
94642024-11-25T19:39:06.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94652024-11-25T19:39:06.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94662024-11-25T19:39:06.225ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
94672024-11-25T19:39:06.225ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.730457ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
94682024-11-25T19:39:07.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1081 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 85a4bd9f-d97a-49cf-b5f5-ec23c061477a response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
94692024-11-25T19:39:07.726ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:39512
94702024-11-25T19:39:07.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39512 req_id = 9f50bf78-6678-461f-8516-0e7788981a26 roles = RoleSet { roles: {} } uri = /metrics/producers
94712024-11-25T19:39:07.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39512 req_id = 9f50bf78-6678-461f-8516-0e7788981a26 resource = Database result = Ok(()) uri = /metrics/producers
94722024-11-25T19:39:07.763ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b2b2b805-c910-42f7-8bd4-d5f05a06bed3
94732024-11-25T19:39:07.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37584 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39512 req_id = 9f50bf78-6678-461f-8516-0e7788981a26 response_code = 201 uri = /metrics/producers
94742024-11-25T19:39:13.237ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:64020
94752024-11-25T19:39:13.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64020 req_id = e57d01eb-28cc-4db4-af1e-125e2e04b026 roles = RoleSet { roles: {} } uri = /metrics/producers
94762024-11-25T19:39:13.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64020 req_id = e57d01eb-28cc-4db4-af1e-125e2e04b026 resource = Database result = Ok(()) uri = /metrics/producers
94772024-11-25T19:39:13.279ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b59496f2-fc6d-46cb-9cf5-9b1a2e24358f
94782024-11-25T19:39:13.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42397 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64020 req_id = e57d01eb-28cc-4db4-af1e-125e2e04b026 response_code = 201 uri = /metrics/producers
94792024-11-25T19:39:16.204ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
94802024-11-25T19:39:16.204ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
94812024-11-25T19:39:16.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94822024-11-25T19:39:16.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
94832024-11-25T19:39:16.204ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
94842024-11-25T19:39:16.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94852024-11-25T19:39:16.204ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
94862024-11-25T19:39:16.204ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
94872024-11-25T19:39:16.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
94882024-11-25T19:39:16.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94892024-11-25T19:39:16.204ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
94902024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.731\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
94912024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
94922024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
94932024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94942024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
94952024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94962024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
94972024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94982024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
94992024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
95002024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95012024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
95022024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95032024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
95042024-11-25T19:39:16.205ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:29:16.204930639 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
95052024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
95062024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
95072024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
95082024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
95092024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95102024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
95112024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
95122024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
95132024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
95142024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
95152024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
95162024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
95172024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
95182024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
95192024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
95202024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
95212024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
95222024-11-25T19:39:16.205ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
95232024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
95242024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95252024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
95262024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
95272024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
95282024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
95292024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
95302024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
95312024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95322024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
95332024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95342024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
95352024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
95362024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
95372024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
95382024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
95392024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95402024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
95412024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95422024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95432024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95442024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95452024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95462024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
95472024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
95482024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95492024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95502024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
95512024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95522024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
95532024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
95542024-11-25T19:39:16.205ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1581, tv_nsec: 750704534 } })
95552024-11-25T19:39:16.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
95562024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95572024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
95582024-11-25T19:39:16.206ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1581, tv_nsec: 750740625 } })
95592024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
95602024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95612024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
95622024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
95632024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
95642024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
95652024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95662024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95672024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
95682024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.399287ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
95692024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
95702024-11-25T19:39:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.199994ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
95712024-11-25T19:39:16.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95722024-11-25T19:39:16.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95732024-11-25T19:39:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95742024-11-25T19:39:16.208ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1581, tv_nsec: 752910058 } })
95752024-11-25T19:39:16.208ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
95762024-11-25T19:39:16.208ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.485199ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
95772024-11-25T19:39:16.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95782024-11-25T19:39:16.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95792024-11-25T19:39:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95802024-11-25T19:39:16.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95812024-11-25T19:39:16.211ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95822024-11-25T19:39:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95832024-11-25T19:39:16.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95842024-11-25T19:39:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95852024-11-25T19:39:16.212ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95862024-11-25T19:39:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95872024-11-25T19:39:16.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95882024-11-25T19:39:16.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95892024-11-25T19:39:16.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
95902024-11-25T19:39:16.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95912024-11-25T19:39:16.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95922024-11-25T19:39:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
95932024-11-25T19:39:16.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
95942024-11-25T19:39:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
95952024-11-25T19:39:16.215ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.796532ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
95962024-11-25T19:39:16.216ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:29:16.204930639 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
95972024-11-25T19:39:16.216ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.091737ms iteration = 9 status = {"expiration":"2024-11-25T19:29:16.204930639Z","pruned":[]}
95982024-11-25T19:39:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
95992024-11-25T19:39:16.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96002024-11-25T19:39:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96012024-11-25T19:39:16.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.231379ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
96022024-11-25T19:39:16.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96032024-11-25T19:39:16.219ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1581, tv_nsec: 763841952 } })
96042024-11-25T19:39:16.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
96052024-11-25T19:39:16.219ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96062024-11-25T19:39:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96072024-11-25T19:39:16.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96082024-11-25T19:39:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96092024-11-25T19:39:16.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
96102024-11-25T19:39:16.221ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96112024-11-25T19:39:16.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96122024-11-25T19:39:16.221ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96132024-11-25T19:39:16.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96142024-11-25T19:39:16.222ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96152024-11-25T19:39:16.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96162024-11-25T19:39:16.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96172024-11-25T19:39:16.224ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
96182024-11-25T19:39:16.224ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96192024-11-25T19:39:16.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96202024-11-25T19:39:16.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96212024-11-25T19:39:16.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
96222024-11-25T19:39:16.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 22.282878ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96232024-11-25T19:39:16.227ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
96242024-11-25T19:39:16.227ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
96252024-11-25T19:39:16.227ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
96262024-11-25T19:39:16.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96272024-11-25T19:39:16.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96282024-11-25T19:39:16.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96292024-11-25T19:39:16.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96302024-11-25T19:39:16.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96312024-11-25T19:39:16.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96322024-11-25T19:39:16.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96332024-11-25T19:39:16.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96342024-11-25T19:39:16.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96352024-11-25T19:39:16.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96362024-11-25T19:39:16.232ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1581, tv_nsec: 777270136 } })
96372024-11-25T19:39:16.232ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
96382024-11-25T19:39:16.232ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
96392024-11-25T19:39:16.232ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
96402024-11-25T19:39:16.232ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 27.688423ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
96412024-11-25T19:39:16.232ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96422024-11-25T19:39:16.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96432024-11-25T19:39:16.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
96442024-11-25T19:39:16.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
96452024-11-25T19:39:16.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96462024-11-25T19:39:16.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96472024-11-25T19:39:16.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96482024-11-25T19:39:16.236ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96492024-11-25T19:39:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96502024-11-25T19:39:16.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96512024-11-25T19:39:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96522024-11-25T19:39:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
96532024-11-25T19:39:16.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96542024-11-25T19:39:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96552024-11-25T19:39:16.239ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96562024-11-25T19:39:16.239ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
96572024-11-25T19:39:16.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96582024-11-25T19:39:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96592024-11-25T19:39:16.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96602024-11-25T19:39:16.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96612024-11-25T19:39:16.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.27502ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
96622024-11-25T19:39:16.248ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96632024-11-25T19:39:16.248ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
96642024-11-25T19:39:16.248ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
96652024-11-25T19:39:16.248ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 43.435622ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
96662024-11-25T19:39:16.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96672024-11-25T19:39:16.255ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96682024-11-25T19:39:16.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96692024-11-25T19:39:16.258ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.759354ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
96702024-11-25T19:39:16.259ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
96712024-11-25T19:39:16.259ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.607161ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
96722024-11-25T19:39:16.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96732024-11-25T19:39:16.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96742024-11-25T19:39:16.263ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
96752024-11-25T19:39:16.263ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.384725ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
96762024-11-25T19:39:16.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96772024-11-25T19:39:16.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96782024-11-25T19:39:16.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96792024-11-25T19:39:16.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96802024-11-25T19:39:16.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96812024-11-25T19:39:16.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96822024-11-25T19:39:16.270ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
96832024-11-25T19:39:16.270ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
96842024-11-25T19:39:16.270ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
96852024-11-25T19:39:16.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96862024-11-25T19:39:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96872024-11-25T19:39:16.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96882024-11-25T19:39:16.275ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96892024-11-25T19:39:16.275ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
96902024-11-25T19:39:16.275ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96912024-11-25T19:39:16.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96922024-11-25T19:39:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
96932024-11-25T19:39:16.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96942024-11-25T19:39:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96952024-11-25T19:39:16.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.453361ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
96962024-11-25T19:39:16.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96972024-11-25T19:39:16.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96982024-11-25T19:39:16.284ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96992024-11-25T19:39:16.286ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97002024-11-25T19:39:16.286ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97012024-11-25T19:39:16.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97022024-11-25T19:39:16.288ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97032024-11-25T19:39:16.290ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97042024-11-25T19:39:16.290ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97052024-11-25T19:39:16.290ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 85.453697ms iteration = 19 status = {"physical_disks_added":0}
97062024-11-25T19:39:16.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97072024-11-25T19:39:16.291ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
97082024-11-25T19:39:16.291ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
97092024-11-25T19:39:16.291ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97102024-11-25T19:39:16.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97112024-11-25T19:39:16.294ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97122024-11-25T19:39:16.294ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97132024-11-25T19:39:16.297ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97142024-11-25T19:39:16.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97152024-11-25T19:39:16.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97162024-11-25T19:39:16.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97172024-11-25T19:39:16.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97182024-11-25T19:39:16.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97192024-11-25T19:39:16.299ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97202024-11-25T19:39:16.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97212024-11-25T19:39:16.299ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97222024-11-25T19:39:16.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97232024-11-25T19:39:16.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97242024-11-25T19:39:16.303ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
97252024-11-25T19:39:16.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97262024-11-25T19:39:16.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97272024-11-25T19:39:16.309ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
97282024-11-25T19:39:16.309ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
97292024-11-25T19:39:16.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97302024-11-25T19:39:16.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97312024-11-25T19:39:16.311ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97322024-11-25T19:39:16.311ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
97332024-11-25T19:39:16.311ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.139042ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
97342024-11-25T19:39:16.360ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
97352024-11-25T19:39:16.370ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
97362024-11-25T19:39:16.398ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97372024-11-25T19:39:16.398ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97382024-11-25T19:39:16.398ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fb796a0-052d-46e3-8a2e-2ace73897ff7", "content-length": "26", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
97392024-11-25T19:39:16.398ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97402024-11-25T19:39:16.402ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97412024-11-25T19:39:16.436ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
97422024-11-25T19:39:16.436ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97432024-11-25T19:39:16.436ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a975129-c34b-40ee-b7df-eea692b02eef", "content-length": "26", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
97442024-11-25T19:39:16.436ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97452024-11-25T19:39:16.439ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
97462024-11-25T19:39:16.462ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97472024-11-25T19:39:16.462ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97482024-11-25T19:39:16.462ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1ce4c33-6d2d-42f3-be6d-49f780fc86a7", "content-length": "26", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
97492024-11-25T19:39:16.462ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97502024-11-25T19:39:16.464ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97512024-11-25T19:39:16.478ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
97522024-11-25T19:39:16.478ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
97532024-11-25T19:39:16.479ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "012a7008-09ba-4fe4-8a40-cf2f1fd06883", "content-length": "372", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
97542024-11-25T19:39:16.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97552024-11-25T19:39:16.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97562024-11-25T19:39:16.545ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
97572024-11-25T19:39:16.551ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
97582024-11-25T19:39:16.551ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3a69c52e-a3de-4a37-9a52-a5e7137072a7", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
97592024-11-25T19:39:16.551ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
97602024-11-25T19:39:16.552ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1865bce7-2ac8-4b6f-bd15-533e6dc1dc5a", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
97612024-11-25T19:39:16.552ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
97622024-11-25T19:39:16.554ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
97632024-11-25T19:39:16.554ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
97642024-11-25T19:39:16.554ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 349.11984ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
97652024-11-25T19:39:16.554ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "be840e90-85cf-425a-b33e-2f64bbf11b5c", "content-length": "691", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
97662024-11-25T19:39:16.554ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
97672024-11-25T19:39:16.554ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
97682024-11-25T19:39:16.554ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
97692024-11-25T19:39:16.555ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 350.519968ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
97702024-11-25T19:39:16.556ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 351.571418ms iteration = 17 status = {}
97712024-11-25T19:39:16.556ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
97722024-11-25T19:39:16.556ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
97732024-11-25T19:39:16.556ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
97742024-11-25T19:39:16.556ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 351.845514ms iteration = 10 status = {"generation":2}
97752024-11-25T19:39:16.557ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97762024-11-25T19:39:16.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97772024-11-25T19:39:16.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97782024-11-25T19:39:16.557ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 352.984076ms iteration = 17 status = 0
97792024-11-25T19:39:16.558ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
97802024-11-25T19:39:16.558ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 353.108868ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
97812024-11-25T19:39:16.559ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97822024-11-25T19:39:16.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97832024-11-25T19:39:16.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97842024-11-25T19:39:16.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97852024-11-25T19:39:16.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97862024-11-25T19:39:16.561ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97872024-11-25T19:39:16.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97882024-11-25T19:39:16.562ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
97892024-11-25T19:39:16.562ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
97902024-11-25T19:39:16.562ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
97912024-11-25T19:39:16.562ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 357.471284ms iteration = 10 status = {"generation":1}
97922024-11-25T19:39:16.565ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 360.266318ms iteration = 17 status = {}
97932024-11-25T19:39:16.595ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
97942024-11-25T19:39:16.595ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 389.926251ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
97952024-11-25T19:39:16.598ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
97962024-11-25T19:39:16.598ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
97972024-11-25T19:39:16.599ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "593e8b24-f0fe-4138-98c2-3c43bef982d0", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
97982024-11-25T19:39:16.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97992024-11-25T19:39:16.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98002024-11-25T19:39:16.601ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98012024-11-25T19:39:16.601ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "73696e77-56bc-4998-beef-d30083a3a428", "content-length": "1", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
98022024-11-25T19:39:16.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98032024-11-25T19:39:16.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98042024-11-25T19:39:16.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98052024-11-25T19:39:16.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98062024-11-25T19:39:16.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98072024-11-25T19:39:16.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98082024-11-25T19:39:16.605ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 400.415366ms iteration = 17 status = null
98092024-11-25T19:39:16.607ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98102024-11-25T19:39:16.607ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98112024-11-25T19:39:16.607ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "54aaad3d-568a-447d-9003-c130e5a7a465", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
98122024-11-25T19:39:16.609ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 404.629239ms iteration = 18 status = {}
98132024-11-25T19:39:16.631ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
98142024-11-25T19:39:16.631ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6acde980-d4da-4aba-a910-81bb656b38a7", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98152024-11-25T19:39:16.631ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98162024-11-25T19:39:16.632ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8fc99246-e74d-4519-b39a-9eefa73ea657", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98172024-11-25T19:39:16.632ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98182024-11-25T19:39:16.634ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0994b9f3-44ac-47ea-95c8-cf86d1956069", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98192024-11-25T19:39:16.634ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98202024-11-25T19:39:16.635ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
98212024-11-25T19:39:16.636ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 430.942816ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
98222024-11-25T19:39:16.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98232024-11-25T19:39:16.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98242024-11-25T19:39:16.677ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
98252024-11-25T19:39:16.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98262024-11-25T19:39:16.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98272024-11-25T19:39:16.683ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
98282024-11-25T19:39:16.683ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd24ef18-5dd4-47b3-831a-52bb58a9ab05", "content-length": "134", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
98292024-11-25T19:39:16.683ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
98302024-11-25T19:39:16.683ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
98312024-11-25T19:39:16.683ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
98322024-11-25T19:39:16.683ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
98332024-11-25T19:39:16.683ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98342024-11-25T19:39:16.683ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98352024-11-25T19:39:16.683ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98362024-11-25T19:39:16.683ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98372024-11-25T19:39:16.684ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98382024-11-25T19:39:16.684ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98392024-11-25T19:39:16.684ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
98402024-11-25T19:39:16.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98412024-11-25T19:39:16.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98422024-11-25T19:39:16.685ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
98432024-11-25T19:39:16.685ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2e2e495-a151-439d-b7e9-0933cf2706aa", "content-length": "2", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
98442024-11-25T19:39:16.685ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
98452024-11-25T19:39:16.685ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3763052-fa1b-4244-b201-bdeee67e7ddd", "content-length": "51", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
98462024-11-25T19:39:16.686ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
98472024-11-25T19:39:16.686ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
98482024-11-25T19:39:16.773ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3ceda023-c1c5-4f91-aa99-c59780024d5a", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
98492024-11-25T19:39:16.773ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
98502024-11-25T19:39:16.773ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
98512024-11-25T19:39:16.773ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1a97b51-6b5e-4e85-84a9-429316824bce", "content-length": "682", "date": "Mon, 25 Nov 2024 19:39:16 GMT"} })
98522024-11-25T19:39:16.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98532024-11-25T19:39:16.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98542024-11-25T19:39:16.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98552024-11-25T19:39:16.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98562024-11-25T19:39:16.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98572024-11-25T19:39:16.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98582024-11-25T19:39:16.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98592024-11-25T19:39:16.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98602024-11-25T19:39:16.787ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 582.114781ms iteration = 17 status = {}
98612024-11-25T19:39:17.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1099 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 5338f4b6-af48-423b-acae-99372fc75947 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
98622024-11-25T19:39:22.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = e5cbfc3d-58ff-481b-ba94-c190f1c7ed5e roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
98632024-11-25T19:39:22.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = e5cbfc3d-58ff-481b-ba94-c190f1c7ed5e resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
98642024-11-25T19:39:22.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = e5cbfc3d-58ff-481b-ba94-c190f1c7ed5e response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
98652024-11-25T19:39:22.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = c0f3a500-7302-4e8a-9b48-6f2117356a13 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
98662024-11-25T19:39:22.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = c0f3a500-7302-4e8a-9b48-6f2117356a13 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
98672024-11-25T19:39:22.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = c0f3a500-7302-4e8a-9b48-6f2117356a13 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
98682024-11-25T19:39:26.203ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
98692024-11-25T19:39:26.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
98702024-11-25T19:39:26.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98712024-11-25T19:39:26.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98722024-11-25T19:39:26.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98732024-11-25T19:39:26.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98742024-11-25T19:39:26.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98752024-11-25T19:39:26.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98762024-11-25T19:39:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98772024-11-25T19:39:26.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98782024-11-25T19:39:26.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98792024-11-25T19:39:26.208ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.835684ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98802024-11-25T19:39:26.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98812024-11-25T19:39:26.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98822024-11-25T19:39:26.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98832024-11-25T19:39:26.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98842024-11-25T19:39:26.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
98852024-11-25T19:39:26.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98862024-11-25T19:39:26.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98872024-11-25T19:39:26.222ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
98882024-11-25T19:39:26.222ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.918201ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
98892024-11-25T19:39:27.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1144 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 0ff78076-8cfc-4dc1-a3b5-00814cd668f8 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
98902024-11-25T19:39:36.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
98912024-11-25T19:39:36.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
98922024-11-25T19:39:36.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98932024-11-25T19:39:36.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98942024-11-25T19:39:36.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98952024-11-25T19:39:36.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98962024-11-25T19:39:36.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98972024-11-25T19:39:36.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98982024-11-25T19:39:36.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98992024-11-25T19:39:36.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99002024-11-25T19:39:36.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99012024-11-25T19:39:36.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99022024-11-25T19:39:36.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99032024-11-25T19:39:36.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99042024-11-25T19:39:36.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99052024-11-25T19:39:36.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
99062024-11-25T19:39:36.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99072024-11-25T19:39:36.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99082024-11-25T19:39:36.224ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
99092024-11-25T19:39:36.224ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.904991ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
99102024-11-25T19:39:36.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.778133ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99112024-11-25T19:39:36.372ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41436
99122024-11-25T19:39:36.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41436 req_id = 0d52ff0c-2245-4bd3-9ef1-5a3770d1d7c7 roles = RoleSet { roles: {} } uri = /metrics/producers
99132024-11-25T19:39:36.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41436 req_id = 0d52ff0c-2245-4bd3-9ef1-5a3770d1d7c7 resource = Database result = Ok(()) uri = /metrics/producers
99142024-11-25T19:39:36.382ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = e1e4675c-73a5-46b5-9e0f-9d05cbba5670
99152024-11-25T19:39:36.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9860 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41436 req_id = 0d52ff0c-2245-4bd3-9ef1-5a3770d1d7c7 response_code = 201 uri = /metrics/producers
99162024-11-25T19:39:37.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = f4c07e5e-1159-48f2-946f-cb031b351804 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
99172024-11-25T19:39:37.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = f4c07e5e-1159-48f2-946f-cb031b351804 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
99182024-11-25T19:39:37.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = f4c07e5e-1159-48f2-946f-cb031b351804 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
99192024-11-25T19:39:37.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 195c7dad-bc88-413d-b994-f0b3af7867b1 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
99202024-11-25T19:39:37.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 195c7dad-bc88-413d-b994-f0b3af7867b1 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
99212024-11-25T19:39:37.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1800 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 195c7dad-bc88-413d-b994-f0b3af7867b1 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
99222024-11-25T19:39:37.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1131 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 49a0afde-f0bb-4434-9dfc-c5ef20a4bc7c response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
99232024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
99242024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
99252024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
99262024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99272024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
99282024-11-25T19:39:46.204ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
99292024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99302024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
99312024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99322024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
99332024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
99342024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
99352024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99362024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
99372024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
99382024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
99392024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
99402024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
99412024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
99422024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99432024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99442024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
99452024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
99462024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
99472024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
99482024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
99492024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
99502024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99512024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
99522024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
99532024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
99542024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
99552024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99562024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
99572024-11-25T19:39:46.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99582024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99592024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
99602024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99612024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99622024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99632024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
99642024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
99652024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99662024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
99672024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
99682024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99692024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
99702024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
99712024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99722024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99732024-11-25T19:39:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99742024-11-25T19:39:46.208ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.242174ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
99752024-11-25T19:39:46.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99762024-11-25T19:39:46.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99772024-11-25T19:39:46.211ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99782024-11-25T19:39:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99792024-11-25T19:39:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
99802024-11-25T19:39:46.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99812024-11-25T19:39:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99822024-11-25T19:39:46.212ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99832024-11-25T19:39:46.212ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
99842024-11-25T19:39:46.212ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99852024-11-25T19:39:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99862024-11-25T19:39:46.213ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
99872024-11-25T19:39:46.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99882024-11-25T19:39:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99892024-11-25T19:39:46.215ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.136648ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
99902024-11-25T19:39:46.216ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1611, tv_nsec: 760601649 } })
99912024-11-25T19:39:46.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99922024-11-25T19:39:46.216ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
99932024-11-25T19:39:46.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99942024-11-25T19:39:46.217ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99952024-11-25T19:39:46.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99962024-11-25T19:39:46.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
99972024-11-25T19:39:46.218ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99982024-11-25T19:39:46.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99992024-11-25T19:39:46.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
100002024-11-25T19:39:46.220ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100012024-11-25T19:39:46.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100022024-11-25T19:39:46.220ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1611, tv_nsec: 765367873 } })
100032024-11-25T19:39:46.221ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
100042024-11-25T19:39:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100052024-11-25T19:39:46.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100062024-11-25T19:39:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
100072024-11-25T19:39:46.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100082024-11-25T19:39:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100092024-11-25T19:39:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100102024-11-25T19:39:46.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100112024-11-25T19:39:46.223ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100122024-11-25T19:39:46.223ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
100132024-11-25T19:39:46.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100142024-11-25T19:39:46.223ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1611, tv_nsec: 768301510 } })
100152024-11-25T19:39:46.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100162024-11-25T19:39:46.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100172024-11-25T19:39:46.224ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
100182024-11-25T19:39:46.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100192024-11-25T19:39:46.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100202024-11-25T19:39:46.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100212024-11-25T19:39:46.225ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100222024-11-25T19:39:46.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100232024-11-25T19:39:46.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100242024-11-25T19:39:46.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100252024-11-25T19:39:46.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100262024-11-25T19:39:46.227ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100272024-11-25T19:39:46.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100282024-11-25T19:39:46.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100292024-11-25T19:39:46.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100302024-11-25T19:39:46.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100312024-11-25T19:39:46.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
100322024-11-25T19:39:46.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100332024-11-25T19:39:46.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100342024-11-25T19:39:46.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 38.068507ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
100352024-11-25T19:39:46.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100362024-11-25T19:39:46.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100372024-11-25T19:39:46.247ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100382024-11-25T19:39:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100392024-11-25T19:39:46.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100402024-11-25T19:39:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100412024-11-25T19:39:46.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.158596ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100422024-11-25T19:39:46.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100432024-11-25T19:39:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100442024-11-25T19:39:46.254ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100452024-11-25T19:39:46.254ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
100462024-11-25T19:39:46.254ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 49.43515ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
100472024-11-25T19:39:46.254ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
100482024-11-25T19:39:46.254ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.882038ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
100492024-11-25T19:39:46.278ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100502024-11-25T19:39:46.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100512024-11-25T19:39:46.333ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
100522024-11-25T19:39:46.333ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
100532024-11-25T19:39:46.333ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3835fdf-ea8a-4e98-bd5d-dace1815c3cf", "content-length": "26", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
100542024-11-25T19:39:46.333ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
100552024-11-25T19:39:46.335ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
100562024-11-25T19:39:46.356ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
100572024-11-25T19:39:46.356ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
100582024-11-25T19:39:46.356ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbeb8d21-c533-48c5-9983-9a57024b2ad7", "content-length": "372", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
100592024-11-25T19:39:46.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100602024-11-25T19:39:46.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100612024-11-25T19:39:46.360ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100622024-11-25T19:39:46.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100632024-11-25T19:39:46.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
100642024-11-25T19:39:46.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 164.493598ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
100652024-11-25T19:39:46.388ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 183.471229ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
100662024-11-25T19:39:46.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100672024-11-25T19:39:46.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
100682024-11-25T19:39:46.399ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100692024-11-25T19:39:46.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100702024-11-25T19:39:46.400ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 196.19515ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
100712024-11-25T19:39:46.401ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100722024-11-25T19:39:46.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100732024-11-25T19:39:46.401ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 196.991025ms iteration = 18 status = 0
100742024-11-25T19:39:46.409ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
100752024-11-25T19:39:46.409ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
100762024-11-25T19:39:46.410ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "38963e06-15df-467b-9ac5-4183ea2cdf4a", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
100772024-11-25T19:39:46.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100782024-11-25T19:39:46.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100792024-11-25T19:39:46.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100802024-11-25T19:39:46.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100812024-11-25T19:39:46.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100822024-11-25T19:39:46.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100832024-11-25T19:39:46.423ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
100842024-11-25T19:39:46.423ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
100852024-11-25T19:39:46.423ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9a5a4858-230a-4e9f-983c-336acd3ef64a", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
100862024-11-25T19:39:46.425ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 220.916494ms iteration = 19 status = {}
100872024-11-25T19:39:46.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 234.713995ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
100882024-11-25T19:39:46.439ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
100892024-11-25T19:39:46.439ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
100902024-11-25T19:39:46.440ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37934cad-e443-40cc-805a-a13a52c4197e", "content-length": "26", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
100912024-11-25T19:39:46.440ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
100922024-11-25T19:39:46.441ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 237.259336ms iteration = 18 status = {}
100932024-11-25T19:39:46.442ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
100942024-11-25T19:39:46.442ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
100952024-11-25T19:39:46.442ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
100962024-11-25T19:39:46.442ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f22c90ba-f131-4f89-a05d-dd2fb44a97b4", "content-length": "26", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
100972024-11-25T19:39:46.442ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
100982024-11-25T19:39:46.444ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
100992024-11-25T19:39:46.456ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 251.471064ms iteration = 20 status = {"physical_disks_added":0}
101002024-11-25T19:39:46.457ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101012024-11-25T19:39:46.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101022024-11-25T19:39:46.486ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101032024-11-25T19:39:46.487ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101042024-11-25T19:39:46.487ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101052024-11-25T19:39:46.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101062024-11-25T19:39:46.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101072024-11-25T19:39:46.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101082024-11-25T19:39:46.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101092024-11-25T19:39:46.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101102024-11-25T19:39:46.503ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
101112024-11-25T19:39:46.503ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "af768b4c-00e1-485b-b7e6-ec88401591f8", "content-length": "1", "date": "Mon, 25 Nov 2024 19:39:45 GMT"} })
101122024-11-25T19:39:46.505ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101132024-11-25T19:39:46.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101142024-11-25T19:39:46.507ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 302.486715ms iteration = 18 status = null
101152024-11-25T19:39:46.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101162024-11-25T19:39:46.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101172024-11-25T19:39:46.592ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
101182024-11-25T19:39:46.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101192024-11-25T19:39:46.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101202024-11-25T19:39:46.598ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
101212024-11-25T19:39:46.598ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "377f467c-b9a2-488f-8b78-2f02f70ba929", "content-length": "691", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
101222024-11-25T19:39:46.598ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
101232024-11-25T19:39:46.598ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
101242024-11-25T19:39:46.598ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
101252024-11-25T19:39:46.600ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 395.660553ms iteration = 18 status = {}
101262024-11-25T19:39:46.601ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
101272024-11-25T19:39:46.601ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "21c5cb70-3284-4307-9665-7a1499edc7f6", "content-length": "134", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
101282024-11-25T19:39:46.601ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
101292024-11-25T19:39:46.601ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
101302024-11-25T19:39:46.601ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
101312024-11-25T19:39:46.602ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
101322024-11-25T19:39:46.602ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
101332024-11-25T19:39:46.602ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
101342024-11-25T19:39:46.602ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
101352024-11-25T19:39:46.602ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
101362024-11-25T19:39:46.602ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
101372024-11-25T19:39:46.602ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
101382024-11-25T19:39:46.602ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
101392024-11-25T19:39:46.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101402024-11-25T19:39:46.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101412024-11-25T19:39:46.604ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
101422024-11-25T19:39:46.604ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "153528ab-f354-48e6-a23b-9c9eeea33e36", "content-length": "2", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
101432024-11-25T19:39:46.604ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
101442024-11-25T19:39:46.604ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa358bfe-a3e5-4a31-94b0-f404938c7725", "content-length": "51", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
101452024-11-25T19:39:46.604ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
101462024-11-25T19:39:46.604ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
101472024-11-25T19:39:46.692ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "171acb2a-a1f8-460b-bb30-b64057df3fd3", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
101482024-11-25T19:39:46.692ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
101492024-11-25T19:39:46.692ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
101502024-11-25T19:39:46.692ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7af3ca6c-a8c2-4443-8374-8434a2c1cea5", "content-length": "682", "date": "Mon, 25 Nov 2024 19:39:46 GMT"} })
101512024-11-25T19:39:46.692ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101522024-11-25T19:39:46.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101532024-11-25T19:39:46.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101542024-11-25T19:39:46.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101552024-11-25T19:39:46.698ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101562024-11-25T19:39:46.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101572024-11-25T19:39:46.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101582024-11-25T19:39:46.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101592024-11-25T19:39:46.708ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 503.774274ms iteration = 18 status = {}
101602024-11-25T19:39:47.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1175 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 385f89b0-a46c-421c-aeb3-2e60e65074d0 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
101612024-11-25T19:39:47.789ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35626
101622024-11-25T19:39:47.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35626 req_id = 7bccc785-26db-40ab-8f0e-71d22600de27 roles = RoleSet { roles: {} } uri = /metrics/producers
101632024-11-25T19:39:47.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35626 req_id = 7bccc785-26db-40ab-8f0e-71d22600de27 resource = Database result = Ok(()) uri = /metrics/producers
101642024-11-25T19:39:47.825ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = d2d29ac8-9dfa-4f1f-be62-a88a71a6b2fa
101652024-11-25T19:39:47.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36142 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35626 req_id = 7bccc785-26db-40ab-8f0e-71d22600de27 response_code = 201 uri = /metrics/producers
101662024-11-25T19:39:52.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 6031b81a-e782-43ce-bb2e-a3bdd20a9251 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
101672024-11-25T19:39:52.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 6031b81a-e782-43ce-bb2e-a3bdd20a9251 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
101682024-11-25T19:39:52.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2644 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 6031b81a-e782-43ce-bb2e-a3bdd20a9251 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
101692024-11-25T19:39:52.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = a34cff04-6799-4b9d-932e-754ca73080c1 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
101702024-11-25T19:39:52.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = a34cff04-6799-4b9d-932e-754ca73080c1 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
101712024-11-25T19:39:52.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = a34cff04-6799-4b9d-932e-754ca73080c1 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
101722024-11-25T19:39:53.737ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38836
101732024-11-25T19:39:53.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38836 req_id = 31d2d055-b29a-4e88-b05b-40b7c9d84246 roles = RoleSet { roles: {} } uri = /metrics/producers
101742024-11-25T19:39:53.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38836 req_id = 31d2d055-b29a-4e88-b05b-40b7c9d84246 resource = Database result = Ok(()) uri = /metrics/producers
101752024-11-25T19:39:53.774ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 4626c149-3efd-47ab-bfa7-bdd3e9545fef
101762024-11-25T19:39:53.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37025 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38836 req_id = 31d2d055-b29a-4e88-b05b-40b7c9d84246 response_code = 201 uri = /metrics/producers
101772024-11-25T19:39:56.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
101782024-11-25T19:39:56.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
101792024-11-25T19:39:56.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101802024-11-25T19:39:56.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101812024-11-25T19:39:56.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101822024-11-25T19:39:56.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101832024-11-25T19:39:56.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101842024-11-25T19:39:56.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101852024-11-25T19:39:56.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101862024-11-25T19:39:56.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101872024-11-25T19:39:56.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101882024-11-25T19:39:56.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101892024-11-25T19:39:56.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101902024-11-25T19:39:56.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101912024-11-25T19:39:56.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101922024-11-25T19:39:56.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
101932024-11-25T19:39:56.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101942024-11-25T19:39:56.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101952024-11-25T19:39:56.228ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
101962024-11-25T19:39:56.228ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.642684ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
101972024-11-25T19:39:56.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.971166ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101982024-11-25T19:39:57.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1138 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = f49c71f6-73aa-4bfd-8bcb-32ee877cdfc9 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
101992024-11-25T19:40:06.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
102002024-11-25T19:40:06.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102012024-11-25T19:40:06.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
102022024-11-25T19:40:06.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102032024-11-25T19:40:06.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102042024-11-25T19:40:06.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102052024-11-25T19:40:06.207ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102062024-11-25T19:40:06.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102072024-11-25T19:40:06.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102082024-11-25T19:40:06.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102092024-11-25T19:40:06.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102102024-11-25T19:40:06.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102112024-11-25T19:40:06.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102122024-11-25T19:40:06.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102132024-11-25T19:40:06.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102142024-11-25T19:40:06.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
102152024-11-25T19:40:06.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102162024-11-25T19:40:06.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102172024-11-25T19:40:06.226ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
102182024-11-25T19:40:06.226ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.893129ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
102192024-11-25T19:40:06.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.887724ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102202024-11-25T19:40:07.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 5f840d44-d472-4a0e-9cd6-dae57adee393 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
102212024-11-25T19:40:07.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 5f840d44-d472-4a0e-9cd6-dae57adee393 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
102222024-11-25T19:40:07.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1780 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 5f840d44-d472-4a0e-9cd6-dae57adee393 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
102232024-11-25T19:40:07.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = c4dc6b2c-1932-4695-9e31-6ebe071580d8 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
102242024-11-25T19:40:07.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = c4dc6b2c-1932-4695-9e31-6ebe071580d8 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
102252024-11-25T19:40:07.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = c4dc6b2c-1932-4695-9e31-6ebe071580d8 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
102262024-11-25T19:40:07.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1118 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = f429b2c6-830a-4a9d-932b-56ff87994843 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
102272024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
102282024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
102292024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102302024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
102312024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
102322024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102332024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
102342024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
102352024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102362024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
102372024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
102382024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
102392024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
102402024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102412024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
102422024-11-25T19:40:16.205ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
102432024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
102442024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
102452024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.27\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
102462024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102472024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
102482024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
102492024-11-25T19:40:16.205ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:30:16.205420639 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
102502024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
102512024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
102522024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
102532024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
102542024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
102552024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102562024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102572024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
102582024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
102592024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
102602024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
102612024-11-25T19:40:16.205ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
102622024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102632024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102642024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
102652024-11-25T19:40:16.205ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
102662024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
102672024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
102682024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
102692024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102702024-11-25T19:40:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
102712024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
102722024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
102732024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
102742024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
102752024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102762024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
102772024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102782024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
102792024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
102802024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102812024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
102822024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102832024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102842024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102852024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
102862024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
102872024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
102882024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102892024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
102902024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102912024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
102922024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102932024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
102942024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102952024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102962024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102972024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102982024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102992024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103002024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
103012024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103022024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
103032024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
103042024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103052024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
103062024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
103072024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
103082024-11-25T19:40:16.206ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1641, tv_nsec: 750560912 } })
103092024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
103102024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
103112024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103122024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103132024-11-25T19:40:16.206ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1641, tv_nsec: 750606403 } })
103142024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103152024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103162024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103172024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103182024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103192024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103202024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103212024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103222024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103232024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103242024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103252024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
103262024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.404907ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
103272024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103282024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
103292024-11-25T19:40:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.370537ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
103302024-11-25T19:40:16.208ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103312024-11-25T19:40:16.208ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.676302ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
103322024-11-25T19:40:16.209ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103332024-11-25T19:40:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
103342024-11-25T19:40:16.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103352024-11-25T19:40:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103362024-11-25T19:40:16.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103372024-11-25T19:40:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103382024-11-25T19:40:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
103392024-11-25T19:40:16.211ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103402024-11-25T19:40:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103412024-11-25T19:40:16.220ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103422024-11-25T19:40:16.220ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.662167ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
103432024-11-25T19:40:16.220ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103442024-11-25T19:40:16.221ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103452024-11-25T19:40:16.222ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1641, tv_nsec: 767105576 } })
103462024-11-25T19:40:16.223ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
103472024-11-25T19:40:16.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103482024-11-25T19:40:16.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103492024-11-25T19:40:16.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
103502024-11-25T19:40:16.223ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103512024-11-25T19:40:16.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103522024-11-25T19:40:16.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103532024-11-25T19:40:16.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
103542024-11-25T19:40:16.224ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
103552024-11-25T19:40:16.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
103562024-11-25T19:40:16.226ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 21.149655ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
103572024-11-25T19:40:16.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103582024-11-25T19:40:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103592024-11-25T19:40:16.230ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:30:16.205420639 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
103602024-11-25T19:40:16.230ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 25.052971ms iteration = 10 status = {"expiration":"2024-11-25T19:30:16.205420639Z","pruned":[]}
103612024-11-25T19:40:16.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103622024-11-25T19:40:16.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103632024-11-25T19:40:16.235ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1641, tv_nsec: 780244084 } })
103642024-11-25T19:40:16.236ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
103652024-11-25T19:40:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
103662024-11-25T19:40:16.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
103672024-11-25T19:40:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103682024-11-25T19:40:16.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103692024-11-25T19:40:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
103702024-11-25T19:40:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103712024-11-25T19:40:16.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1641, tv_nsec: 787694320 } })
103722024-11-25T19:40:16.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
103732024-11-25T19:40:16.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.811651ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
103742024-11-25T19:40:16.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103752024-11-25T19:40:16.246ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103762024-11-25T19:40:16.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103772024-11-25T19:40:16.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103782024-11-25T19:40:16.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103792024-11-25T19:40:16.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103802024-11-25T19:40:16.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103812024-11-25T19:40:16.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103822024-11-25T19:40:16.259ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103832024-11-25T19:40:16.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103842024-11-25T19:40:16.259ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103852024-11-25T19:40:16.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103862024-11-25T19:40:16.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103872024-11-25T19:40:16.261ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103882024-11-25T19:40:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
103892024-11-25T19:40:16.265ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103902024-11-25T19:40:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103912024-11-25T19:40:16.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103922024-11-25T19:40:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103932024-11-25T19:40:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103942024-11-25T19:40:16.267ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103952024-11-25T19:40:16.270ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103962024-11-25T19:40:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103972024-11-25T19:40:16.270ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103982024-11-25T19:40:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103992024-11-25T19:40:16.272ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104002024-11-25T19:40:16.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104012024-11-25T19:40:16.272ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104022024-11-25T19:40:16.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104032024-11-25T19:40:16.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104042024-11-25T19:40:16.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104052024-11-25T19:40:16.280ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104062024-11-25T19:40:16.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
104072024-11-25T19:40:16.281ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104082024-11-25T19:40:16.282ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104092024-11-25T19:40:16.282ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
104102024-11-25T19:40:16.282ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104112024-11-25T19:40:16.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104122024-11-25T19:40:16.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
104132024-11-25T19:40:16.283ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104142024-11-25T19:40:16.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104152024-11-25T19:40:16.283ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104162024-11-25T19:40:16.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104172024-11-25T19:40:16.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104182024-11-25T19:40:16.283ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104192024-11-25T19:40:16.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104202024-11-25T19:40:16.285ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104212024-11-25T19:40:16.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104222024-11-25T19:40:16.285ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104232024-11-25T19:40:16.286ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
104242024-11-25T19:40:16.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
104252024-11-25T19:40:16.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104262024-11-25T19:40:16.287ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104272024-11-25T19:40:16.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104282024-11-25T19:40:16.290ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
104292024-11-25T19:40:16.290ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
104302024-11-25T19:40:16.290ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 84.400096ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
104312024-11-25T19:40:16.291ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
104322024-11-25T19:40:16.291ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.849455ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
104332024-11-25T19:40:16.291ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
104342024-11-25T19:40:16.291ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
104352024-11-25T19:40:16.291ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.921126ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
104362024-11-25T19:40:16.297ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
104372024-11-25T19:40:16.297ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
104382024-11-25T19:40:16.297ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
104392024-11-25T19:40:16.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104402024-11-25T19:40:16.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104412024-11-25T19:40:16.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104422024-11-25T19:40:16.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
104432024-11-25T19:40:16.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
104442024-11-25T19:40:16.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
104452024-11-25T19:40:16.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.092744ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104462024-11-25T19:40:16.332ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
104472024-11-25T19:40:16.332ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
104482024-11-25T19:40:16.332ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
104492024-11-25T19:40:16.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104502024-11-25T19:40:16.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104512024-11-25T19:40:16.346ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
104522024-11-25T19:40:16.357ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104532024-11-25T19:40:16.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104542024-11-25T19:40:16.387ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
104552024-11-25T19:40:16.387ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104562024-11-25T19:40:16.387ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b77ba46b-56c7-4f95-b5f7-20f8d1b48a6b", "content-length": "26", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
104572024-11-25T19:40:16.387ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104582024-11-25T19:40:16.389ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
104592024-11-25T19:40:16.404ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
104602024-11-25T19:40:16.404ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
104612024-11-25T19:40:16.405ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c48caf6-6971-4a4a-b954-0b250335e79f", "content-length": "26", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
104622024-11-25T19:40:16.405ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104632024-11-25T19:40:16.406ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
104642024-11-25T19:40:16.418ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
104652024-11-25T19:40:16.440ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
104662024-11-25T19:40:16.440ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104672024-11-25T19:40:16.440ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7616ec3-c3c3-45fe-a830-a53df523d84c", "content-length": "372", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
104682024-11-25T19:40:16.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104692024-11-25T19:40:16.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104702024-11-25T19:40:16.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104712024-11-25T19:40:16.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104722024-11-25T19:40:16.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104732024-11-25T19:40:16.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104742024-11-25T19:40:16.446ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 240.680092ms iteration = 5 status = {"nsuccess":5}
104752024-11-25T19:40:16.472ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104762024-11-25T19:40:16.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104772024-11-25T19:40:16.483ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104782024-11-25T19:40:16.484ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104792024-11-25T19:40:16.485ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
104802024-11-25T19:40:16.485ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104812024-11-25T19:40:16.485ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104822024-11-25T19:40:16.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104832024-11-25T19:40:16.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104842024-11-25T19:40:16.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
104852024-11-25T19:40:16.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104862024-11-25T19:40:16.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104872024-11-25T19:40:16.489ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 283.535963ms iteration = 21 status = {"physical_disks_added":0}
104882024-11-25T19:40:16.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104892024-11-25T19:40:16.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 287.416089ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
104902024-11-25T19:40:16.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 287.619093ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
104912024-11-25T19:40:16.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104922024-11-25T19:40:16.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104932024-11-25T19:40:16.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104942024-11-25T19:40:16.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104952024-11-25T19:40:16.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104962024-11-25T19:40:16.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104972024-11-25T19:40:16.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104982024-11-25T19:40:16.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104992024-11-25T19:40:16.497ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
105002024-11-25T19:40:16.497ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
105012024-11-25T19:40:16.497ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105022024-11-25T19:40:16.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105032024-11-25T19:40:16.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105042024-11-25T19:40:16.499ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
105052024-11-25T19:40:16.499ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105062024-11-25T19:40:16.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105072024-11-25T19:40:16.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105082024-11-25T19:40:16.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105092024-11-25T19:40:16.500ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a3d220c-add8-499c-91a0-321a0dae8396", "content-length": "26", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
105102024-11-25T19:40:16.500ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105112024-11-25T19:40:16.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
105122024-11-25T19:40:16.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105132024-11-25T19:40:16.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105142024-11-25T19:40:16.505ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 299.446835ms iteration = 19 status = 0
105152024-11-25T19:40:16.505ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
105162024-11-25T19:40:16.505ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 299.984006ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
105172024-11-25T19:40:16.506ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105182024-11-25T19:40:16.514ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
105192024-11-25T19:40:16.514ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ce9fe52b-91fe-4809-af3b-afc3ab007e90", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
105202024-11-25T19:40:16.514ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
105212024-11-25T19:40:16.516ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "870ef947-fbe8-4522-89f0-7ea12d2852d2", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
105222024-11-25T19:40:16.516ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
105232024-11-25T19:40:16.518ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
105242024-11-25T19:40:16.518ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 313.009672ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
105252024-11-25T19:40:16.526ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105262024-11-25T19:40:16.527ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
105272024-11-25T19:40:16.527ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
105282024-11-25T19:40:16.527ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7ab41160-3d30-4e39-a729-c3dacec21182", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
105292024-11-25T19:40:16.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105302024-11-25T19:40:16.527ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
105312024-11-25T19:40:16.527ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105322024-11-25T19:40:16.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105332024-11-25T19:40:16.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105342024-11-25T19:40:16.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105352024-11-25T19:40:16.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105362024-11-25T19:40:16.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 328.108398ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
105372024-11-25T19:40:16.534ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105382024-11-25T19:40:16.534ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
105392024-11-25T19:40:16.534ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 328.993775ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
105402024-11-25T19:40:16.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105412024-11-25T19:40:16.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105422024-11-25T19:40:16.538ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
105432024-11-25T19:40:16.538ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105442024-11-25T19:40:16.538ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d6c3e293-7a3e-445b-b062-3453b520a6f6", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
105452024-11-25T19:40:16.540ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 334.85413ms iteration = 20 status = {}
105462024-11-25T19:40:16.542ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
105472024-11-25T19:40:16.542ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
105482024-11-25T19:40:16.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105492024-11-25T19:40:16.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105502024-11-25T19:40:16.544ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105512024-11-25T19:40:16.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105522024-11-25T19:40:16.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105532024-11-25T19:40:16.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105542024-11-25T19:40:16.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105552024-11-25T19:40:16.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
105562024-11-25T19:40:16.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105572024-11-25T19:40:16.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105582024-11-25T19:40:16.551ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
105592024-11-25T19:40:16.551ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
105602024-11-25T19:40:16.551ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
105612024-11-25T19:40:16.551ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 345.870876ms iteration = 11 status = {"generation":2}
105622024-11-25T19:40:16.552ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
105632024-11-25T19:40:16.552ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
105642024-11-25T19:40:16.552ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
105652024-11-25T19:40:16.552ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 346.457028ms iteration = 11 status = {"generation":1}
105662024-11-25T19:40:16.561ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
105672024-11-25T19:40:16.561ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 355.76436ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
105682024-11-25T19:40:16.570ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105692024-11-25T19:40:16.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105702024-11-25T19:40:16.571ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105712024-11-25T19:40:16.572ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
105722024-11-25T19:40:16.572ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 367.200975ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
105732024-11-25T19:40:16.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105742024-11-25T19:40:16.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105752024-11-25T19:40:16.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105762024-11-25T19:40:16.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105772024-11-25T19:40:16.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105782024-11-25T19:40:16.577ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105792024-11-25T19:40:16.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105802024-11-25T19:40:16.611ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
105812024-11-25T19:40:16.637ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 431.525917ms iteration = 19 status = {}
105822024-11-25T19:40:16.677ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
105832024-11-25T19:40:16.677ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d729295-37f2-458c-8929-7b456e2b4c08", "content-length": "1", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
105842024-11-25T19:40:16.680ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105852024-11-25T19:40:16.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105862024-11-25T19:40:16.683ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 477.413987ms iteration = 19 status = null
105872024-11-25T19:40:16.718ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
105882024-11-25T19:40:16.719ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "12986af0-abcf-48c7-8609-39f45955861d", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105892024-11-25T19:40:16.719ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105902024-11-25T19:40:16.721ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1eea354a-f4b3-4d20-8f7e-be6a85a5437b", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105912024-11-25T19:40:16.721ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105922024-11-25T19:40:16.722ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6bfcd4e9-f456-4ae0-9795-fec54ceb26b7", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105932024-11-25T19:40:16.722ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105942024-11-25T19:40:16.724ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105952024-11-25T19:40:16.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 519.203317ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
105962024-11-25T19:40:16.731ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
105972024-11-25T19:40:16.732ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ff79957-3289-4987-97e6-9d883c2a0fd8", "content-length": "691", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
105982024-11-25T19:40:16.732ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
105992024-11-25T19:40:16.732ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
106002024-11-25T19:40:16.732ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
106012024-11-25T19:40:16.733ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 527.581391ms iteration = 19 status = {}
106022024-11-25T19:40:16.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106032024-11-25T19:40:16.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106042024-11-25T19:40:16.769ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
106052024-11-25T19:40:16.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106062024-11-25T19:40:16.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106072024-11-25T19:40:16.779ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
106082024-11-25T19:40:16.779ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fec0230-6563-4897-bfb8-aadc9e2e7853", "content-length": "134", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
106092024-11-25T19:40:16.779ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
106102024-11-25T19:40:16.779ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
106112024-11-25T19:40:16.780ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
106122024-11-25T19:40:16.780ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
106132024-11-25T19:40:16.780ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106142024-11-25T19:40:16.780ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106152024-11-25T19:40:16.780ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106162024-11-25T19:40:16.780ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106172024-11-25T19:40:16.780ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
106182024-11-25T19:40:16.780ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
106192024-11-25T19:40:16.780ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
106202024-11-25T19:40:16.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106212024-11-25T19:40:16.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106222024-11-25T19:40:16.782ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
106232024-11-25T19:40:16.782ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8033e3d2-3cc7-4c2d-9e8c-6d6a4715c72e", "content-length": "2", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
106242024-11-25T19:40:16.782ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
106252024-11-25T19:40:16.782ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "be7ee815-c9c4-428c-9d59-ea8b51522666", "content-length": "51", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
106262024-11-25T19:40:16.782ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
106272024-11-25T19:40:16.782ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
106282024-11-25T19:40:16.876ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6a219151-32d5-4da9-9492-e97f8f0ea39a", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
106292024-11-25T19:40:16.876ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
106302024-11-25T19:40:16.876ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
106312024-11-25T19:40:16.876ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c74c656-bffb-46e3-9bd0-75f0e2a129de", "content-length": "682", "date": "Mon, 25 Nov 2024 19:40:16 GMT"} })
106322024-11-25T19:40:16.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106332024-11-25T19:40:16.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106342024-11-25T19:40:16.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106352024-11-25T19:40:16.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106362024-11-25T19:40:16.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106372024-11-25T19:40:16.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106382024-11-25T19:40:16.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106392024-11-25T19:40:16.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106402024-11-25T19:40:16.900ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 695.648399ms iteration = 19 status = {}
106412024-11-25T19:40:17.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1346 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 7d8f23e5-1999-4b10-ae69-bc5cac613eb7 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
106422024-11-25T19:40:26.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
106432024-11-25T19:40:26.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
106442024-11-25T19:40:26.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106452024-11-25T19:40:26.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106462024-11-25T19:40:26.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106472024-11-25T19:40:26.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106482024-11-25T19:40:26.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106492024-11-25T19:40:26.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106502024-11-25T19:40:26.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106512024-11-25T19:40:26.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106522024-11-25T19:40:26.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106532024-11-25T19:40:26.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106542024-11-25T19:40:26.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106552024-11-25T19:40:26.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
106562024-11-25T19:40:26.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106572024-11-25T19:40:26.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106582024-11-25T19:40:26.228ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
106592024-11-25T19:40:26.228ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.397039ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
106602024-11-25T19:40:26.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106612024-11-25T19:40:26.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106622024-11-25T19:40:26.263ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.183881ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106632024-11-25T19:40:27.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1351 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = bce4c4ca-735b-4445-bdc8-05ca11a2a914 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
106642024-11-25T19:40:36.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
106652024-11-25T19:40:36.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
106662024-11-25T19:40:36.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106672024-11-25T19:40:36.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106682024-11-25T19:40:36.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106692024-11-25T19:40:36.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106702024-11-25T19:40:36.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106712024-11-25T19:40:36.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106722024-11-25T19:40:36.208ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.008609ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106732024-11-25T19:40:36.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106742024-11-25T19:40:36.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106752024-11-25T19:40:36.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106762024-11-25T19:40:36.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106772024-11-25T19:40:36.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106782024-11-25T19:40:36.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106792024-11-25T19:40:36.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106802024-11-25T19:40:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
106812024-11-25T19:40:36.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106822024-11-25T19:40:36.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106832024-11-25T19:40:36.253ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
106842024-11-25T19:40:36.253ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.93174ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
106852024-11-25T19:40:37.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 46487acb-d897-4757-a3ce-ad6c04e19a8b roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
106862024-11-25T19:40:37.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 46487acb-d897-4757-a3ce-ad6c04e19a8b resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
106872024-11-25T19:40:37.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 46487acb-d897-4757-a3ce-ad6c04e19a8b response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
106882024-11-25T19:40:37.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = dce795dc-eb1c-4a2f-bcba-79591ab2a1f4 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
106892024-11-25T19:40:37.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = dce795dc-eb1c-4a2f-bcba-79591ab2a1f4 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
106902024-11-25T19:40:37.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = dce795dc-eb1c-4a2f-bcba-79591ab2a1f4 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
106912024-11-25T19:40:37.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1188 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 5a95d41a-1aa7-4741-93d1-84e8bd5e54f7 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
106922024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
106932024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106942024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
106952024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106962024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
106972024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
106982024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106992024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
107002024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
107012024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107022024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
107032024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
107042024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
107052024-11-25T19:40:46.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107062024-11-25T19:40:46.204ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
107072024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
107082024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107092024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107102024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
107112024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
107122024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
107132024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
107142024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
107152024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107162024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
107172024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
107182024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107192024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
107202024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
107212024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107222024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107232024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
107242024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
107252024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
107262024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
107272024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107282024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107292024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
107302024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
107312024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107322024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107332024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107342024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
107352024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107362024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107372024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107382024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107392024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107402024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107412024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107422024-11-25T19:40:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
107432024-11-25T19:40:46.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107442024-11-25T19:40:46.207ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107452024-11-25T19:40:46.208ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.998068ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
107462024-11-25T19:40:46.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
107472024-11-25T19:40:46.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107482024-11-25T19:40:46.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107492024-11-25T19:40:46.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107502024-11-25T19:40:46.209ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107512024-11-25T19:40:46.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107522024-11-25T19:40:46.210ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
107532024-11-25T19:40:46.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
107542024-11-25T19:40:46.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107552024-11-25T19:40:46.211ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1671, tv_nsec: 755810815 } })
107562024-11-25T19:40:46.212ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
107572024-11-25T19:40:46.212ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1671, tv_nsec: 756658782 } })
107582024-11-25T19:40:46.212ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107592024-11-25T19:40:46.212ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
107602024-11-25T19:40:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107612024-11-25T19:40:46.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107622024-11-25T19:40:46.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107632024-11-25T19:40:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
107642024-11-25T19:40:46.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107652024-11-25T19:40:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107662024-11-25T19:40:46.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107672024-11-25T19:40:46.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
107682024-11-25T19:40:46.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
107692024-11-25T19:40:46.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107702024-11-25T19:40:46.219ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107712024-11-25T19:40:46.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107722024-11-25T19:40:46.220ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1671, tv_nsec: 764982525 } })
107732024-11-25T19:40:46.221ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
107742024-11-25T19:40:46.221ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107752024-11-25T19:40:46.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107762024-11-25T19:40:46.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107772024-11-25T19:40:46.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107782024-11-25T19:40:46.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107792024-11-25T19:40:46.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107802024-11-25T19:40:46.223ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107812024-11-25T19:40:46.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107822024-11-25T19:40:46.225ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107832024-11-25T19:40:46.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107842024-11-25T19:40:46.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 33.225322ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
107852024-11-25T19:40:46.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107862024-11-25T19:40:46.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107872024-11-25T19:40:46.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107882024-11-25T19:40:46.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107892024-11-25T19:40:46.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107902024-11-25T19:40:46.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107912024-11-25T19:40:46.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107922024-11-25T19:40:46.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107932024-11-25T19:40:46.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107942024-11-25T19:40:46.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107952024-11-25T19:40:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107962024-11-25T19:40:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107972024-11-25T19:40:46.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107982024-11-25T19:40:46.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.152415ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
107992024-11-25T19:40:46.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108002024-11-25T19:40:46.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108012024-11-25T19:40:46.255ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108022024-11-25T19:40:46.255ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
108032024-11-25T19:40:46.255ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108042024-11-25T19:40:46.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108052024-11-25T19:40:46.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108062024-11-25T19:40:46.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108072024-11-25T19:40:46.262ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
108082024-11-25T19:40:46.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
108092024-11-25T19:40:46.264ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.59977ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
108102024-11-25T19:40:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
108112024-11-25T19:40:46.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108122024-11-25T19:40:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108132024-11-25T19:40:46.264ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.929646ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
108142024-11-25T19:40:46.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108152024-11-25T19:40:46.265ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.366315ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108162024-11-25T19:40:46.267ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.18393ms iteration = 20 status = 0
108172024-11-25T19:40:46.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
108182024-11-25T19:40:46.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108192024-11-25T19:40:46.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108202024-11-25T19:40:46.271ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
108212024-11-25T19:40:46.271ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.714499ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
108222024-11-25T19:40:46.281ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
108232024-11-25T19:40:46.281ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.406869ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
108242024-11-25T19:40:46.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 80.419218ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
108252024-11-25T19:40:46.290ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
108262024-11-25T19:40:46.290ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108272024-11-25T19:40:46.290ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "be375cea-d7c5-4347-bdab-637c08b90084", "content-length": "26", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
108282024-11-25T19:40:46.290ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108292024-11-25T19:40:46.290ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
108302024-11-25T19:40:46.290ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108312024-11-25T19:40:46.291ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f74cd19-241e-4751-822a-8abc711c85e8", "content-length": "26", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
108322024-11-25T19:40:46.291ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108332024-11-25T19:40:46.293ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108342024-11-25T19:40:46.293ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108352024-11-25T19:40:46.294ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108362024-11-25T19:40:46.294ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
108372024-11-25T19:40:46.294ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108382024-11-25T19:40:46.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108392024-11-25T19:40:46.296ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108402024-11-25T19:40:46.296ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
108412024-11-25T19:40:46.296ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 91.587047ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
108422024-11-25T19:40:46.311ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
108432024-11-25T19:40:46.311ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108442024-11-25T19:40:46.311ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5b4dc86-3329-42f7-b3e2-7aadf32ec9e3", "content-length": "26", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
108452024-11-25T19:40:46.311ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108462024-11-25T19:40:46.313ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
108472024-11-25T19:40:46.316ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108482024-11-25T19:40:46.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108492024-11-25T19:40:46.326ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.164247ms iteration = 22 status = {"physical_disks_added":0}
108502024-11-25T19:40:46.373ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
108512024-11-25T19:40:46.373ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d49e478c-4aa3-4a66-aca4-f7773f56bc7c", "content-length": "1", "date": "Mon, 25 Nov 2024 19:40:45 GMT"} })
108522024-11-25T19:40:46.376ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108532024-11-25T19:40:46.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108542024-11-25T19:40:46.380ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 175.558914ms iteration = 20 status = {}
108552024-11-25T19:40:46.399ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
108562024-11-25T19:40:46.399ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108572024-11-25T19:40:46.399ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "04e1f87f-d997-4112-be78-89f9d76e2243", "content-length": "372", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
108582024-11-25T19:40:46.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108592024-11-25T19:40:46.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108602024-11-25T19:40:46.401ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 196.808411ms iteration = 20 status = null
108612024-11-25T19:40:46.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108622024-11-25T19:40:46.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108632024-11-25T19:40:46.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108642024-11-25T19:40:46.414ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108652024-11-25T19:40:46.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108662024-11-25T19:40:46.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108672024-11-25T19:40:46.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108682024-11-25T19:40:46.417ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108692024-11-25T19:40:46.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108702024-11-25T19:40:46.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108712024-11-25T19:40:46.443ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
108722024-11-25T19:40:46.443ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
108732024-11-25T19:40:46.443ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b6b2f055-67fd-45eb-86a6-98e531a24ce9", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
108742024-11-25T19:40:46.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108752024-11-25T19:40:46.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108762024-11-25T19:40:46.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108772024-11-25T19:40:46.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108782024-11-25T19:40:46.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108792024-11-25T19:40:46.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108802024-11-25T19:40:46.452ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
108812024-11-25T19:40:46.452ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108822024-11-25T19:40:46.452ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3edef302-0ac4-4c1f-9033-5a9f3f8080eb", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
108832024-11-25T19:40:46.454ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 249.22977ms iteration = 21 status = {}
108842024-11-25T19:40:46.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108852024-11-25T19:40:46.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108862024-11-25T19:40:46.463ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
108872024-11-25T19:40:46.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108882024-11-25T19:40:46.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108892024-11-25T19:40:46.473ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
108902024-11-25T19:40:46.473ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a88752c-c5e5-4044-a5a3-a9c998717ab1", "content-length": "134", "date": "Mon, 25 Nov 2024 19:40:45 GMT"} })
108912024-11-25T19:40:46.473ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
108922024-11-25T19:40:46.473ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
108932024-11-25T19:40:46.473ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
108942024-11-25T19:40:46.473ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
108952024-11-25T19:40:46.473ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108962024-11-25T19:40:46.473ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108972024-11-25T19:40:46.473ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108982024-11-25T19:40:46.473ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
108992024-11-25T19:40:46.474ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109002024-11-25T19:40:46.474ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109012024-11-25T19:40:46.474ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
109022024-11-25T19:40:46.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109032024-11-25T19:40:46.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109042024-11-25T19:40:46.475ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
109052024-11-25T19:40:46.476ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "542fb438-0402-479c-9053-50d8a6f2ca5b", "content-length": "2", "date": "Mon, 25 Nov 2024 19:40:45 GMT"} })
109062024-11-25T19:40:46.476ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
109072024-11-25T19:40:46.476ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9ed1737-b1de-4099-a6ac-affc5361e664", "content-length": "51", "date": "Mon, 25 Nov 2024 19:40:45 GMT"} })
109082024-11-25T19:40:46.476ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
109092024-11-25T19:40:46.476ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
109102024-11-25T19:40:46.507ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
109112024-11-25T19:40:46.566ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2f8297e2-5673-416b-a594-3004e07741b4", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
109122024-11-25T19:40:46.566ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
109132024-11-25T19:40:46.566ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
109142024-11-25T19:40:46.566ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bed9d40-6dd5-4dd7-a118-ab928ea61d9a", "content-length": "691", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
109152024-11-25T19:40:46.566ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
109162024-11-25T19:40:46.566ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
109172024-11-25T19:40:46.566ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
109182024-11-25T19:40:46.566ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "90bfcfa8-86c1-42d9-8845-ab5b611e9242", "content-length": "682", "date": "Mon, 25 Nov 2024 19:40:46 GMT"} })
109192024-11-25T19:40:46.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109202024-11-25T19:40:46.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109212024-11-25T19:40:46.568ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 363.950651ms iteration = 20 status = {}
109222024-11-25T19:40:46.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109232024-11-25T19:40:46.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109242024-11-25T19:40:46.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109252024-11-25T19:40:46.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109262024-11-25T19:40:46.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109272024-11-25T19:40:46.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109282024-11-25T19:40:46.581ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 377.291542ms iteration = 20 status = {}
109292024-11-25T19:40:47.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1222 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = ff139c10-d2b5-4a33-892a-2a5c83f49d8c response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
109302024-11-25T19:40:52.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 0c1a906b-a1d8-4119-b092-262d65c55327 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
109312024-11-25T19:40:52.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 0c1a906b-a1d8-4119-b092-262d65c55327 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
109322024-11-25T19:40:52.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = 0c1a906b-a1d8-4119-b092-262d65c55327 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
109332024-11-25T19:40:52.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = c3aab42b-3085-46d2-9dcf-c92a8788363c roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
109342024-11-25T19:40:52.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = c3aab42b-3085-46d2-9dcf-c92a8788363c resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
109352024-11-25T19:40:52.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2663 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34460 req_id = c3aab42b-3085-46d2-9dcf-c92a8788363c response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
109362024-11-25T19:40:56.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
109372024-11-25T19:40:56.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
109382024-11-25T19:40:56.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109392024-11-25T19:40:56.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109402024-11-25T19:40:56.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109412024-11-25T19:40:56.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109422024-11-25T19:40:56.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109432024-11-25T19:40:56.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109442024-11-25T19:40:56.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109452024-11-25T19:40:56.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109462024-11-25T19:40:56.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109472024-11-25T19:40:56.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109482024-11-25T19:40:56.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109492024-11-25T19:40:56.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
109502024-11-25T19:40:56.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109512024-11-25T19:40:56.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109522024-11-25T19:40:56.224ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
109532024-11-25T19:40:56.224ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.017033ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
109542024-11-25T19:40:56.234ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109552024-11-25T19:40:56.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109562024-11-25T19:40:56.270ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.856452ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109572024-11-25T19:40:57.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1582 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = ab5deac9-ea68-4874-8ad0-7e4cc10eaf5f response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
109582024-11-25T19:41:06.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
109592024-11-25T19:41:06.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109602024-11-25T19:41:06.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
109612024-11-25T19:41:06.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109622024-11-25T19:41:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109632024-11-25T19:41:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109642024-11-25T19:41:06.207ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109652024-11-25T19:41:06.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109662024-11-25T19:41:06.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109672024-11-25T19:41:06.208ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.256574ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109682024-11-25T19:41:06.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109692024-11-25T19:41:06.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109702024-11-25T19:41:06.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109712024-11-25T19:41:06.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109722024-11-25T19:41:06.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109732024-11-25T19:41:06.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109742024-11-25T19:41:06.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
109752024-11-25T19:41:06.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109762024-11-25T19:41:06.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109772024-11-25T19:41:06.228ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
109782024-11-25T19:41:06.228ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.347079ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
109792024-11-25T19:41:07.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 03f37d24-9095-4826-bc9b-5b421938de0c response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
109802024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
109812024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109822024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
109832024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
109842024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
109852024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109862024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
109872024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
109882024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
109892024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
109902024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
109912024-11-25T19:41:16.205ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:31:16.205328647 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
109922024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109932024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
109942024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
109952024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
109962024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109972024-11-25T19:41:16.205ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
109982024-11-25T19:41:16.205ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
109992024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
110002024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
110012024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
110022024-11-25T19:41:16.205ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
110032024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
110042024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110052024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
110062024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110072024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110082024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
110092024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
110102024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
110112024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
110122024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
110132024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110142024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110152024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
110162024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110172024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
110182024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
110192024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
110202024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
110212024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110222024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
110232024-11-25T19:41:16.205ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
110242024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110252024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
110262024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110272024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
110282024-11-25T19:41:16.205ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
110292024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110302024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
110312024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110322024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
110332024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
110342024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110352024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
110362024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
110372024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
110382024-11-25T19:41:16.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110392024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
110402024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
110412024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
110422024-11-25T19:41:16.206ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
110432024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
110442024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.12\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
110452024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110462024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
110472024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
110482024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
110492024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110502024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110512024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
110522024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
110532024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
110542024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110552024-11-25T19:41:16.206ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
110562024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110572024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110582024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110592024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
110602024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110612024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110622024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110632024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110642024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110652024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
110662024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110672024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110682024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
110692024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
110702024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110712024-11-25T19:41:16.206ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1701, tv_nsec: 750116723 } })
110722024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110732024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110742024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110752024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110762024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
110772024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110782024-11-25T19:41:16.206ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1701, tv_nsec: 750234285 } })
110792024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
110802024-11-25T19:41:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.433408ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
110812024-11-25T19:41:16.207ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
110822024-11-25T19:41:16.207ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.407587ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
110832024-11-25T19:41:16.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110842024-11-25T19:41:16.208ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:31:16.205328647 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
110852024-11-25T19:41:16.208ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.234093ms iteration = 11 status = {"expiration":"2024-11-25T19:31:16.205328647Z","pruned":[]}
110862024-11-25T19:41:16.208ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110872024-11-25T19:41:16.209ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.971457ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
110882024-11-25T19:41:16.209ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.185242ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
110892024-11-25T19:41:16.209ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110902024-11-25T19:41:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
110912024-11-25T19:41:16.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110922024-11-25T19:41:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110932024-11-25T19:41:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
110942024-11-25T19:41:16.210ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110952024-11-25T19:41:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
110962024-11-25T19:41:16.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110972024-11-25T19:41:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110982024-11-25T19:41:16.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
110992024-11-25T19:41:16.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111002024-11-25T19:41:16.211ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111012024-11-25T19:41:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111022024-11-25T19:41:16.212ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111032024-11-25T19:41:16.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111042024-11-25T19:41:16.214ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
111052024-11-25T19:41:16.214ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111062024-11-25T19:41:16.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111072024-11-25T19:41:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
111082024-11-25T19:41:16.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111092024-11-25T19:41:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111102024-11-25T19:41:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111112024-11-25T19:41:16.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111122024-11-25T19:41:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111132024-11-25T19:41:16.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111142024-11-25T19:41:16.217ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111152024-11-25T19:41:16.217ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
111162024-11-25T19:41:16.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111172024-11-25T19:41:16.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111182024-11-25T19:41:16.218ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111192024-11-25T19:41:16.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
111202024-11-25T19:41:16.219ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
111212024-11-25T19:41:16.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111222024-11-25T19:41:16.219ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111232024-11-25T19:41:16.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111242024-11-25T19:41:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111252024-11-25T19:41:16.220ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111262024-11-25T19:41:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111272024-11-25T19:41:16.222ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1701, tv_nsec: 765947044 } })
111282024-11-25T19:41:16.222ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
111292024-11-25T19:41:16.223ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1701, tv_nsec: 766951343 } })
111302024-11-25T19:41:16.223ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
111312024-11-25T19:41:16.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111322024-11-25T19:41:16.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111332024-11-25T19:41:16.225ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
111342024-11-25T19:41:16.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111352024-11-25T19:41:16.225ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1701, tv_nsec: 769698307 } })
111362024-11-25T19:41:16.226ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
111372024-11-25T19:41:16.227ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111382024-11-25T19:41:16.227ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111392024-11-25T19:41:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111402024-11-25T19:41:16.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111412024-11-25T19:41:16.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111422024-11-25T19:41:16.228ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111432024-11-25T19:41:16.228ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
111442024-11-25T19:41:16.228ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111452024-11-25T19:41:16.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111462024-11-25T19:41:16.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111472024-11-25T19:41:16.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111482024-11-25T19:41:16.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111492024-11-25T19:41:16.230ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(4cc640c1-8be3-451a-af98-2c0913656c3d, 0), (3cff3489-5262-460c-9672-e9e1fc276c52, 0), (50f178f1-acf7-478b-9ba7-68e1b53861af, 0), (11c9f838-30d8-4855-9f92-f2b664ec0890, 0)] collection_id = 4cc640c1-8be3-451a-af98-2c0913656c3d
111502024-11-25T19:41:16.230ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111512024-11-25T19:41:16.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111522024-11-25T19:41:16.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111532024-11-25T19:41:16.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111542024-11-25T19:41:16.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 27.883427ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111552024-11-25T19:41:16.236ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111562024-11-25T19:41:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
111572024-11-25T19:41:16.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111582024-11-25T19:41:16.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111592024-11-25T19:41:16.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111602024-11-25T19:41:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
111612024-11-25T19:41:16.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111622024-11-25T19:41:16.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111632024-11-25T19:41:16.248ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111642024-11-25T19:41:16.248ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
111652024-11-25T19:41:16.248ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 42.965473ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
111662024-11-25T19:41:16.250ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111672024-11-25T19:41:16.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111682024-11-25T19:41:16.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.85103ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
111692024-11-25T19:41:16.252ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111702024-11-25T19:41:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111712024-11-25T19:41:16.254ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
111722024-11-25T19:41:16.254ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
111732024-11-25T19:41:16.254ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 49.520191ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
111742024-11-25T19:41:16.257ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
111752024-11-25T19:41:16.257ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
111762024-11-25T19:41:16.257ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
111772024-11-25T19:41:16.257ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
111782024-11-25T19:41:16.257ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 25cac5a7-37ac-4a12-b0f0-7e53c6142940
111792024-11-25T19:41:16.257ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 9be84436-91fc-4277-8bf1-e17eb446ee29
111802024-11-25T19:41:16.259ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111812024-11-25T19:41:16.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111822024-11-25T19:41:16.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111832024-11-25T19:41:16.260ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = e13bda68-59d8-4518-9325-e38219b4fbf4
111842024-11-25T19:41:16.260ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 55.60538ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
111852024-11-25T19:41:16.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111862024-11-25T19:41:16.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111872024-11-25T19:41:16.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111882024-11-25T19:41:16.263ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111892024-11-25T19:41:16.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111902024-11-25T19:41:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111912024-11-25T19:41:16.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
111922024-11-25T19:41:16.267ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
111932024-11-25T19:41:16.267ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
111942024-11-25T19:41:16.267ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 61.828483ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
111952024-11-25T19:41:16.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111962024-11-25T19:41:16.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111972024-11-25T19:41:16.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111982024-11-25T19:41:16.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111992024-11-25T19:41:16.270ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
112002024-11-25T19:41:16.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112012024-11-25T19:41:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
112022024-11-25T19:41:16.271ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112032024-11-25T19:41:16.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112042024-11-25T19:41:16.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112052024-11-25T19:41:16.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112062024-11-25T19:41:16.273ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
112072024-11-25T19:41:16.273ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.032785ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
112082024-11-25T19:41:16.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.32576ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
112092024-11-25T19:41:16.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
112102024-11-25T19:41:16.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112112024-11-25T19:41:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112122024-11-25T19:41:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112132024-11-25T19:41:16.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
112142024-11-25T19:41:16.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112152024-11-25T19:41:16.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112162024-11-25T19:41:16.277ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
112172024-11-25T19:41:16.277ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.341069ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
112182024-11-25T19:41:16.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112192024-11-25T19:41:16.278ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112202024-11-25T19:41:16.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112212024-11-25T19:41:16.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112222024-11-25T19:41:16.280ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
112232024-11-25T19:41:16.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112242024-11-25T19:41:16.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112252024-11-25T19:41:16.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
112262024-11-25T19:41:16.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112272024-11-25T19:41:16.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112282024-11-25T19:41:16.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112292024-11-25T19:41:16.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112302024-11-25T19:41:16.284ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.266365ms iteration = 21 status = 0
112312024-11-25T19:41:16.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112322024-11-25T19:41:16.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
112332024-11-25T19:41:16.290ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112342024-11-25T19:41:16.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112352024-11-25T19:41:16.294ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
112362024-11-25T19:41:16.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
112372024-11-25T19:41:16.295ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112382024-11-25T19:41:16.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112392024-11-25T19:41:16.295ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112402024-11-25T19:41:16.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112412024-11-25T19:41:16.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.77995ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112422024-11-25T19:41:16.299ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112432024-11-25T19:41:16.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112442024-11-25T19:41:16.300ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112452024-11-25T19:41:16.301ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
112462024-11-25T19:41:16.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112472024-11-25T19:41:16.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112482024-11-25T19:41:16.302ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 96.654357ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
112492024-11-25T19:41:16.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112502024-11-25T19:41:16.302ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
112512024-11-25T19:41:16.302ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
112522024-11-25T19:41:16.302ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
112532024-11-25T19:41:16.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112542024-11-25T19:41:16.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112552024-11-25T19:41:16.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112562024-11-25T19:41:16.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.285278ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
112572024-11-25T19:41:16.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112582024-11-25T19:41:16.304ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112592024-11-25T19:41:16.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112602024-11-25T19:41:16.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112612024-11-25T19:41:16.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112622024-11-25T19:41:16.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112632024-11-25T19:41:16.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112642024-11-25T19:41:16.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112652024-11-25T19:41:16.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112662024-11-25T19:41:16.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112672024-11-25T19:41:16.309ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112682024-11-25T19:41:16.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112692024-11-25T19:41:16.310ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 4cc640c1-8be3-451a-af98-2c0913656c3d file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
112702024-11-25T19:41:16.310ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112712024-11-25T19:41:16.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112722024-11-25T19:41:16.310ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112732024-11-25T19:41:16.313ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
112742024-11-25T19:41:16.314ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(3cff3489-5262-460c-9672-e9e1fc276c52, 0), (50f178f1-acf7-478b-9ba7-68e1b53861af, 0), (11c9f838-30d8-4855-9f92-f2b664ec0890, 0), (22dda696-7685-4d0a-9656-e52449f525ae, 0)] collection_id = 3cff3489-5262-460c-9672-e9e1fc276c52
112752024-11-25T19:41:16.314ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112762024-11-25T19:41:16.315ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
112772024-11-25T19:41:16.315ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
112782024-11-25T19:41:16.315ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
112792024-11-25T19:41:16.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112802024-11-25T19:41:16.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112812024-11-25T19:41:16.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112822024-11-25T19:41:16.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
112832024-11-25T19:41:16.316ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112842024-11-25T19:41:16.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112852024-11-25T19:41:16.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112862024-11-25T19:41:16.317ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112872024-11-25T19:41:16.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112882024-11-25T19:41:16.319ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112892024-11-25T19:41:16.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112902024-11-25T19:41:16.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112912024-11-25T19:41:16.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112922024-11-25T19:41:16.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112932024-11-25T19:41:16.321ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112942024-11-25T19:41:16.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112952024-11-25T19:41:16.322ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
112962024-11-25T19:41:16.322ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
112972024-11-25T19:41:16.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112982024-11-25T19:41:16.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112992024-11-25T19:41:16.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113002024-11-25T19:41:16.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113012024-11-25T19:41:16.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113022024-11-25T19:41:16.325ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113032024-11-25T19:41:16.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113042024-11-25T19:41:16.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
113052024-11-25T19:41:16.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113062024-11-25T19:41:16.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113072024-11-25T19:41:16.327ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113082024-11-25T19:41:16.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113092024-11-25T19:41:16.328ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
113102024-11-25T19:41:16.328ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
113112024-11-25T19:41:16.328ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
113122024-11-25T19:41:16.328ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113132024-11-25T19:41:16.328ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 123.32388ms iteration = 12 status = {"generation":1}
113142024-11-25T19:41:16.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
113152024-11-25T19:41:16.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113162024-11-25T19:41:16.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113172024-11-25T19:41:16.333ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113182024-11-25T19:41:16.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113192024-11-25T19:41:16.335ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113202024-11-25T19:41:16.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113212024-11-25T19:41:16.335ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
113222024-11-25T19:41:16.335ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
113232024-11-25T19:41:16.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113242024-11-25T19:41:16.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113252024-11-25T19:41:16.338ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
113262024-11-25T19:41:16.338ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 133.119942ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
113272024-11-25T19:41:16.339ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113282024-11-25T19:41:16.340ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 3cff3489-5262-460c-9672-e9e1fc276c52 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
113292024-11-25T19:41:16.340ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
113302024-11-25T19:41:16.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113312024-11-25T19:41:16.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
113322024-11-25T19:41:16.342ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113332024-11-25T19:41:16.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113342024-11-25T19:41:16.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
113352024-11-25T19:41:16.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113362024-11-25T19:41:16.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113372024-11-25T19:41:16.344ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
113382024-11-25T19:41:16.344ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113392024-11-25T19:41:16.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113402024-11-25T19:41:16.344ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
113412024-11-25T19:41:16.344ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
113422024-11-25T19:41:16.344ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
113432024-11-25T19:41:16.344ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 139.576478ms iteration = 12 status = {"generation":2}
113442024-11-25T19:41:16.346ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(50f178f1-acf7-478b-9ba7-68e1b53861af, 0), (11c9f838-30d8-4855-9f92-f2b664ec0890, 0), (22dda696-7685-4d0a-9656-e52449f525ae, 0)]
113452024-11-25T19:41:16.346ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1701, tv_nsec: 890677461 } })
113462024-11-25T19:41:16.356ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113472024-11-25T19:41:16.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113482024-11-25T19:41:16.358ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113492024-11-25T19:41:16.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113502024-11-25T19:41:16.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113512024-11-25T19:41:16.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113522024-11-25T19:41:16.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113532024-11-25T19:41:16.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113542024-11-25T19:41:16.365ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113552024-11-25T19:41:16.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113562024-11-25T19:41:16.376ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
113572024-11-25T19:41:16.388ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 182.571772ms iteration = 23 status = {"physical_disks_added":0}
113582024-11-25T19:41:16.395ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
113592024-11-25T19:41:16.395ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 189.913686ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
113602024-11-25T19:41:16.395ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
113612024-11-25T19:41:16.395ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113622024-11-25T19:41:16.395ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d275f10-5c3e-4c8e-844c-d017c4b4bddf", "content-length": "26", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
113632024-11-25T19:41:16.395ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113642024-11-25T19:41:16.398ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
113652024-11-25T19:41:16.400ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113662024-11-25T19:41:16.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113672024-11-25T19:41:16.402ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113682024-11-25T19:41:16.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113692024-11-25T19:41:16.404ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113702024-11-25T19:41:16.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
113712024-11-25T19:41:16.407ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113722024-11-25T19:41:16.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113732024-11-25T19:41:16.413ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
113742024-11-25T19:41:16.413ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113752024-11-25T19:41:16.414ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c74180ff-6364-4acc-9ad7-884877278ce8", "content-length": "26", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
113762024-11-25T19:41:16.414ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113772024-11-25T19:41:16.415ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
113782024-11-25T19:41:16.455ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113792024-11-25T19:41:16.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113802024-11-25T19:41:16.510ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
113812024-11-25T19:41:16.544ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
113822024-11-25T19:41:16.544ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113832024-11-25T19:41:16.545ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f4bf804-6c85-4aed-930b-c409afdb30ed", "content-length": "26", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
113842024-11-25T19:41:16.545ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113852024-11-25T19:41:16.547ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
113862024-11-25T19:41:16.600ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
113872024-11-25T19:41:16.600ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113882024-11-25T19:41:16.600ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "12895691-f68f-4c6b-a076-f4476f552f67", "content-length": "372", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
113892024-11-25T19:41:16.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113902024-11-25T19:41:16.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113912024-11-25T19:41:16.601ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113922024-11-25T19:41:16.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113932024-11-25T19:41:16.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113942024-11-25T19:41:16.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113952024-11-25T19:41:16.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113962024-11-25T19:41:16.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113972024-11-25T19:41:16.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113982024-11-25T19:41:16.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113992024-11-25T19:41:16.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114002024-11-25T19:41:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114012024-11-25T19:41:16.641ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114022024-11-25T19:41:16.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114032024-11-25T19:41:16.643ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114042024-11-25T19:41:16.646ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
114052024-11-25T19:41:16.647ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114062024-11-25T19:41:16.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114072024-11-25T19:41:16.648ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
114082024-11-25T19:41:16.648ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
114092024-11-25T19:41:16.648ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "17a0cf4d-981e-4294-bca6-9b340d948567", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114102024-11-25T19:41:16.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114112024-11-25T19:41:16.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114122024-11-25T19:41:16.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114132024-11-25T19:41:16.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114142024-11-25T19:41:16.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114152024-11-25T19:41:16.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114162024-11-25T19:41:16.654ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
114172024-11-25T19:41:16.654ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114182024-11-25T19:41:16.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114192024-11-25T19:41:16.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114202024-11-25T19:41:16.656ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
114212024-11-25T19:41:16.656ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114222024-11-25T19:41:16.656ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "88a44f3b-923d-42aa-a7a3-930898a82427", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114232024-11-25T19:41:16.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
114242024-11-25T19:41:16.657ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114252024-11-25T19:41:16.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114262024-11-25T19:41:16.658ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 452.708823ms iteration = 22 status = {}
114272024-11-25T19:41:16.659ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
114282024-11-25T19:41:16.659ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: d231a61b-6b3d-4ea9-b8ff-35ab162113d2, kind: Service { id: 5e357e48-2959-4886-8b9d-557b95c45fb7 }, name: Name("external-dns-5e357e48-2959-4886-8b9d-557b95c45fb7"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 146])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f04f2a94-1775-401c-8f4b-f933311d21a8, kind: Service { id: 6b3cbeea-c72e-481d-a7a1-e27c601ccb03 }, name: Name("external-dns-6b3cbeea-c72e-481d-a7a1-e27c601ccb03"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 189])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5304be8f-eb23-4485-b885-5b368db0b5b6, kind: Service { id: 1d808376-6b5a-46f0-b373-d7ba578556eb }, name: Name("nexus-1d808376-6b5a-46f0-b373-d7ba578556eb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 88])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7c489787-90c9-4b93-99c1-8a1f226c1096, kind: Service { id: a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67 }, name: Name("nexus-a9e4fe56-4bc9-4138-aa8c-5ab6c1fb6d67"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 21])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d755e6b0-59ef-4a09-9894-b39bfb858111, kind: Service { id: 29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037 }, name: Name("nexus-29e2fd98-f1e5-4d2c-9541-cf5d2cc3c037"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 3])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
114292024-11-25T19:41:16.659ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
114302024-11-25T19:41:16.666ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
114312024-11-25T19:41:16.667ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "47d658b1-dbc8-4818-bb76-814a57827f99", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
114322024-11-25T19:41:16.667ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
114332024-11-25T19:41:16.668ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d1cdde89-4f20-40e9-ba92-0fe7d1443d6c", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
114342024-11-25T19:41:16.668ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
114352024-11-25T19:41:16.669ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
114362024-11-25T19:41:16.669ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 464.378141ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
114372024-11-25T19:41:16.709ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 38711855-ef69-4d79-bb75-aebd85b1280b, time_created: 2024-11-25T19:31:33.165388Z, time_modified: 2024-11-25T19:31:33.165388Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
114382024-11-25T19:41:16.709ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
114392024-11-25T19:41:16.709ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114402024-11-25T19:41:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114412024-11-25T19:41:16.711ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114422024-11-25T19:41:16.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114432024-11-25T19:41:16.713ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114442024-11-25T19:41:16.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
114452024-11-25T19:41:16.719ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
114462024-11-25T19:41:16.720ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a1580c13-2b99-48f0-a3b5-dc3e2ffc9c98", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
114472024-11-25T19:41:16.720ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
114482024-11-25T19:41:16.722ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c4411f15-cb66-47e8-a35d-a8589e2c1d2f", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
114492024-11-25T19:41:16.722ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
114502024-11-25T19:41:16.723ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6de06c0d-42e3-4f19-9643-05dc1cb86d98", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
114512024-11-25T19:41:16.723ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
114522024-11-25T19:41:16.724ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
114532024-11-25T19:41:16.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 519.112525ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
114542024-11-25T19:41:16.761ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
114552024-11-25T19:41:16.761ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
114562024-11-25T19:41:16.761ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
114572024-11-25T19:41:16.761ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "d858a816-6311-4847-b306-052e304b173e", "content-length": "476", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114582024-11-25T19:41:16.761ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
114592024-11-25T19:41:16.761ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ece98f5e-ac67-498d-b533-9223384eb31a", "content-length": "734", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114602024-11-25T19:41:16.761ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
114612024-11-25T19:41:16.761ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "032cf876-58d8-4dae-a0b2-1dd0365a09e7", "content-length": "111", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114622024-11-25T19:41:16.761ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
114632024-11-25T19:41:16.762ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b707930c-3711-4f84-bbff-da800af880b7", "content-length": "111", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114642024-11-25T19:41:16.762ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
114652024-11-25T19:41:16.762ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e80d31ea-785d-47a5-bac7-f14834ee8769", "content-length": "167", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114662024-11-25T19:41:16.762ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
114672024-11-25T19:41:16.762ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f4c3dd3-d62c-4144-83c9-16c8d61dcd97", "content-length": "167", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114682024-11-25T19:41:16.762ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
114692024-11-25T19:41:16.762ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "27c6827f-bdf8-4d28-b79b-d27af419fab8", "content-length": "175", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114702024-11-25T19:41:16.762ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
114712024-11-25T19:41:16.763ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "80209702-2cea-47f0-8c86-f39c8de9289c", "content-length": "175", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114722024-11-25T19:41:16.763ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
114732024-11-25T19:41:16.763ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2378096-02bc-4c84-829e-70eba907b2f1", "content-length": "702", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114742024-11-25T19:41:16.763ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114752024-11-25T19:41:16.763ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b071950a-4c24-4cd6-abee-4c283c46fcf1", "content-length": "727", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114762024-11-25T19:41:16.763ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114772024-11-25T19:41:16.763ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "db3b8b64-2620-44ba-8bb7-6fdd65ae702a", "content-length": "729", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114782024-11-25T19:41:16.763ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114792024-11-25T19:41:16.763ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ec1456e-919e-422f-86f3-bc59c8a1475e", "content-length": "728", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114802024-11-25T19:41:16.763ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
114812024-11-25T19:41:16.763ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9eb4a865-89ec-46e4-bc08-7a0245b2de93", "content-length": "722", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114822024-11-25T19:41:16.763ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
114832024-11-25T19:41:16.764ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c250183f-838a-469b-aa0c-3018aa3bc909", "content-length": "109", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114842024-11-25T19:41:16.764ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
114852024-11-25T19:41:16.764ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "be98e634-4d7e-4a4e-a1dc-27d200df3ef2", "content-length": "109", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114862024-11-25T19:41:16.764ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
114872024-11-25T19:41:16.764ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a681a29-37f2-4e3b-b3fb-6d958329cee2", "content-length": "169", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114882024-11-25T19:41:16.764ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
114892024-11-25T19:41:16.764ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "19fc6d62-f23d-457c-8636-958db1a51420", "content-length": "169", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114902024-11-25T19:41:16.764ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
114912024-11-25T19:41:16.765ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bc4f7bb-1505-495a-a582-27c6446c591c", "content-length": "178", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114922024-11-25T19:41:16.765ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
114932024-11-25T19:41:16.765ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "12926f3c-b83a-4614-8df8-ba0472bbb7c9", "content-length": "178", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114942024-11-25T19:41:16.765ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
114952024-11-25T19:41:16.765ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "73871166-680c-4d17-8b7c-4384cf437cb1", "content-length": "702", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114962024-11-25T19:41:16.765ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
114972024-11-25T19:41:16.765ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1e16311-5dd7-4c41-80de-ad8ad553c27d", "content-length": "727", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
114982024-11-25T19:41:16.765ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
114992024-11-25T19:41:16.765ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2476906d-d0f1-4154-b4db-4896bf260024", "content-length": "729", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
115002024-11-25T19:41:16.765ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
115012024-11-25T19:41:16.765ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b259755-3530-44fe-9edf-9605d177569c", "content-length": "728", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
115022024-11-25T19:41:16.765ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115032024-11-25T19:41:16.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115042024-11-25T19:41:16.767ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115052024-11-25T19:41:16.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
115062024-11-25T19:41:16.769ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115072024-11-25T19:41:16.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115082024-11-25T19:41:16.771ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 565.975374ms iteration = 21 status = {}
115092024-11-25T19:41:16.826ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
115102024-11-25T19:41:16.826ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "56e1b828-3835-40fa-b134-7de78db18f36", "content-length": "1", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
115112024-11-25T19:41:16.828ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115122024-11-25T19:41:16.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115132024-11-25T19:41:16.832ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
115142024-11-25T19:41:16.832ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c71eb36-0198-40cc-b4a9-998fa5e66858", "content-length": "691", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
115152024-11-25T19:41:16.832ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
115162024-11-25T19:41:16.832ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
115172024-11-25T19:41:16.832ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
115182024-11-25T19:41:16.833ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115192024-11-25T19:41:16.833ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 628.293927ms iteration = 21 status = {}
115202024-11-25T19:41:16.834ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 628.851189ms iteration = 21 status = null
115212024-11-25T19:41:16.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
115222024-11-25T19:41:16.835ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115232024-11-25T19:41:16.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115242024-11-25T19:41:16.858ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
115252024-11-25T19:41:16.859ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "33bf596c-695c-4add-971f-33b729d50aff", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
115262024-11-25T19:41:16.861ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
115272024-11-25T19:41:16.861ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 655.998482ms
115282024-11-25T19:41:16.861ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 656.007551ms iteration = 3 status = {}
115292024-11-25T19:41:16.951ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
115302024-11-25T19:41:16.951ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
115312024-11-25T19:41:16.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115322024-11-25T19:41:16.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115332024-11-25T19:41:16.954ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
115342024-11-25T19:41:16.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115352024-11-25T19:41:16.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115362024-11-25T19:41:16.962ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
115372024-11-25T19:41:16.963ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "94569335-c74a-46a2-be2a-d33ba3fe2034", "content-length": "134", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
115382024-11-25T19:41:16.963ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
115392024-11-25T19:41:16.963ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
115402024-11-25T19:41:16.963ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
115412024-11-25T19:41:16.963ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
115422024-11-25T19:41:16.963ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115432024-11-25T19:41:16.963ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115442024-11-25T19:41:16.963ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115452024-11-25T19:41:16.963ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115462024-11-25T19:41:16.963ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115472024-11-25T19:41:16.963ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115482024-11-25T19:41:16.963ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
115492024-11-25T19:41:16.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115502024-11-25T19:41:16.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115512024-11-25T19:41:16.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
115522024-11-25T19:41:16.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a08f5da9-ccb1-4ba3-81ea-8b7e8b2dd0ef", "content-length": "2", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
115532024-11-25T19:41:16.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
115542024-11-25T19:41:16.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8924dad9-3bc6-476a-9b64-095fd03029ea", "content-length": "51", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
115552024-11-25T19:41:16.967ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
115562024-11-25T19:41:16.967ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
115572024-11-25T19:41:17.114ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8b388c6d-feef-4fa7-acbb-a43a40bf6061", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
115582024-11-25T19:41:17.115ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
115592024-11-25T19:41:17.115ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
115602024-11-25T19:41:17.115ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d04553c-e857-4a1b-9e71-87c8847af2ea", "content-length": "682", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
115612024-11-25T19:41:17.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115622024-11-25T19:41:17.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115632024-11-25T19:41:17.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115642024-11-25T19:41:17.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115652024-11-25T19:41:17.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115662024-11-25T19:41:17.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115672024-11-25T19:41:17.133ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115682024-11-25T19:41:17.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115692024-11-25T19:41:17.144ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 939.054414ms iteration = 21 status = {}
115702024-11-25T19:41:17.269ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2942ff7-db19-4b4c-ae18-188eb50ab3fe", "content-length": "30762", "date": "Mon, 25 Nov 2024 19:41:16 GMT"} })
115712024-11-25T19:41:17.271ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
115722024-11-25T19:41:17.271ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
115732024-11-25T19:41:17.271ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
115742024-11-25T19:41:17.273ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115752024-11-25T19:41:17.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115762024-11-25T19:41:17.275ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115772024-11-25T19:41:17.277ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
115782024-11-25T19:41:17.278ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115792024-11-25T19:41:17.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115802024-11-25T19:41:17.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1102 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = f9886c5b-ea87-4285-80a0-9ab7e623eb50 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
115812024-11-25T19:41:17.461ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 80564aee-33c6-4024-95ac-8c94b578325f file = nexus/db-queries/src/db/datastore/inventory.rs:1000
115822024-11-25T19:41:17.462ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 80564aee-33c6-4024-95ac-8c94b578325f time_started = 2024-11-25 19:41:16.760991 UTC
115832024-11-25T19:41:17.462ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.256628766s iteration = 3 status = {"collection_id":"80564aee-33c6-4024-95ac-8c94b578325f","time_done":"2024-11-25 19:41:17.271293 UTC","time_started":"2024-11-25 19:41:16.760991 UTC"}
115842024-11-25T19:41:17.462ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
115852024-11-25T19:41:17.462ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115862024-11-25T19:41:17.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115872024-11-25T19:41:17.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115882024-11-25T19:41:17.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115892024-11-25T19:41:17.466ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115902024-11-25T19:41:17.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115912024-11-25T19:41:17.471ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115922024-11-25T19:41:17.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115932024-11-25T19:41:17.474ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115942024-11-25T19:41:17.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115952024-11-25T19:41:17.477ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115962024-11-25T19:41:17.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115972024-11-25T19:41:17.519ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 56.940127ms iteration = 24 status = {"physical_disks_added":0}
115982024-11-25T19:41:26.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
115992024-11-25T19:41:26.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116002024-11-25T19:41:26.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
116012024-11-25T19:41:26.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116022024-11-25T19:41:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116032024-11-25T19:41:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116042024-11-25T19:41:26.207ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116052024-11-25T19:41:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116062024-11-25T19:41:26.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116072024-11-25T19:41:26.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116082024-11-25T19:41:26.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116092024-11-25T19:41:26.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116102024-11-25T19:41:26.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116112024-11-25T19:41:26.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116122024-11-25T19:41:26.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116132024-11-25T19:41:26.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
116142024-11-25T19:41:26.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116152024-11-25T19:41:26.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116162024-11-25T19:41:26.228ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
116172024-11-25T19:41:26.228ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.107484ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
116182024-11-25T19:41:26.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.702413ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116192024-11-25T19:41:27.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1244 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = a1044c03-8f3d-4d9a-bf86-ddbef276884b response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
116202024-11-25T19:41:28.781ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:55988
116212024-11-25T19:41:28.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55988 req_id = 7932accf-8dad-4068-a1e2-4ed7c1c609ed roles = RoleSet { roles: {} } uri = /metrics/producers
116222024-11-25T19:41:28.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55988 req_id = 7932accf-8dad-4068-a1e2-4ed7c1c609ed resource = Database result = Ok(()) uri = /metrics/producers
116232024-11-25T19:41:28.817ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 38711855-ef69-4d79-bb75-aebd85b1280b
116242024-11-25T19:41:28.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36107 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55988 req_id = 7932accf-8dad-4068-a1e2-4ed7c1c609ed response_code = 201 uri = /metrics/producers
116252024-11-25T19:41:35.255ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
116262024-11-25T19:41:35.255ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
116272024-11-25T19:41:35.286ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
116282024-11-25T19:41:35.286ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:35807
116292024-11-25T19:41:35.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35807 req_id = 8bc28c56-ed76-4a3b-b89d-0f930e9d9d24 roles = RoleSet { roles: {} } uri = /metrics/producers
116302024-11-25T19:41:35.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35807 req_id = 8bc28c56-ed76-4a3b-b89d-0f930e9d9d24 resource = Database result = Ok(()) uri = /metrics/producers
116312024-11-25T19:41:35.330ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
116322024-11-25T19:41:35.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43311 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:35807 req_id = 8bc28c56-ed76-4a3b-b89d-0f930e9d9d24 response_code = 201 uri = /metrics/producers
116332024-11-25T19:41:35.330ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "8bc28c56-ed76-4a3b-b89d-0f930e9d9d24", "content-length": "41", "date": "Mon, 25 Nov 2024 19:41:35 GMT"} })
116342024-11-25T19:41:35.331ZDEBGnexus (producer-registration-task): registered with nexus successfully
116352024-11-25T19:41:35.331ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
116362024-11-25T19:41:36.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
116372024-11-25T19:41:36.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116382024-11-25T19:41:36.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
116392024-11-25T19:41:36.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116402024-11-25T19:41:36.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116412024-11-25T19:41:36.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116422024-11-25T19:41:36.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116432024-11-25T19:41:36.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116442024-11-25T19:41:36.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116452024-11-25T19:41:36.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116462024-11-25T19:41:36.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116472024-11-25T19:41:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116482024-11-25T19:41:36.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116492024-11-25T19:41:36.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
116502024-11-25T19:41:36.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116512024-11-25T19:41:36.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116522024-11-25T19:41:36.232ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
116532024-11-25T19:41:36.232ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.757155ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
116542024-11-25T19:41:36.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116552024-11-25T19:41:36.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116562024-11-25T19:41:36.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.902874ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116572024-11-25T19:41:37.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1124 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 4956c761-fae2-41b4-9963-347dd49c16ab response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
116582024-11-25T19:41:37.800ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53871
116592024-11-25T19:41:37.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53871 req_id = 8aafcaf8-2dc7-49f5-97f3-3f4d21781deb roles = RoleSet { roles: {} } uri = /metrics/producers
116602024-11-25T19:41:37.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53871 req_id = 8aafcaf8-2dc7-49f5-97f3-3f4d21781deb resource = Database result = Ok(()) uri = /metrics/producers
116612024-11-25T19:41:37.835ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b2b2b805-c910-42f7-8bd4-d5f05a06bed3
116622024-11-25T19:41:37.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35088 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53871 req_id = 8aafcaf8-2dc7-49f5-97f3-3f4d21781deb response_code = 201 uri = /metrics/producers
116632024-11-25T19:41:43.316ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:52803
116642024-11-25T19:41:43.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52803 req_id = fa57c8b8-d77a-4104-a69b-6b1198d654fb roles = RoleSet { roles: {} } uri = /metrics/producers
116652024-11-25T19:41:43.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52803 req_id = fa57c8b8-d77a-4104-a69b-6b1198d654fb resource = Database result = Ok(()) uri = /metrics/producers
116662024-11-25T19:41:43.352ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b59496f2-fc6d-46cb-9cf5-9b1a2e24358f
116672024-11-25T19:41:43.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36689 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52803 req_id = fa57c8b8-d77a-4104-a69b-6b1198d654fb response_code = 201 uri = /metrics/producers
116682024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
116692024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116702024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
116712024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
116722024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
116732024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116742024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
116752024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
116762024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
116772024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
116782024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
116792024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
116802024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
116812024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
116822024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
116832024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
116842024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
116852024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
116862024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116872024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
116882024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
116892024-11-25T19:41:46.205ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
116902024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116912024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
116922024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
116932024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116942024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116952024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
116962024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
116972024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
116982024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116992024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
117002024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
117012024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
117022024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117032024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117042024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117052024-11-25T19:41:46.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117062024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
117072024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
117082024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117092024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117102024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
117112024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117122024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117132024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117142024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117152024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
117162024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
117172024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117182024-11-25T19:41:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117192024-11-25T19:41:46.208ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.280465ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
117202024-11-25T19:41:46.209ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117212024-11-25T19:41:46.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117222024-11-25T19:41:46.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1731, tv_nsec: 754004919 } })
117232024-11-25T19:41:46.210ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1731, tv_nsec: 754185103 } })
117242024-11-25T19:41:46.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
117252024-11-25T19:41:46.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
117262024-11-25T19:41:46.210ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117272024-11-25T19:41:46.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117282024-11-25T19:41:46.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117292024-11-25T19:41:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
117302024-11-25T19:41:46.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117312024-11-25T19:41:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117322024-11-25T19:41:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117332024-11-25T19:41:46.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117342024-11-25T19:41:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117352024-11-25T19:41:46.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
117362024-11-25T19:41:46.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117372024-11-25T19:41:46.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117382024-11-25T19:41:46.218ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117392024-11-25T19:41:46.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.981075ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117402024-11-25T19:41:46.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117412024-11-25T19:41:46.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117422024-11-25T19:41:46.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
117432024-11-25T19:41:46.221ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117442024-11-25T19:41:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117452024-11-25T19:41:46.223ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117462024-11-25T19:41:46.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117472024-11-25T19:41:46.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117482024-11-25T19:41:46.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
117492024-11-25T19:41:46.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117502024-11-25T19:41:46.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117512024-11-25T19:41:46.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117522024-11-25T19:41:46.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117532024-11-25T19:41:46.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117542024-11-25T19:41:46.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
117552024-11-25T19:41:46.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117562024-11-25T19:41:46.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117572024-11-25T19:41:46.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117582024-11-25T19:41:46.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
117592024-11-25T19:41:46.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117602024-11-25T19:41:46.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117612024-11-25T19:41:46.249ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117622024-11-25T19:41:46.249ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
117632024-11-25T19:41:46.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117642024-11-25T19:41:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117652024-11-25T19:41:46.250ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
117662024-11-25T19:41:46.250ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.525253ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
117672024-11-25T19:41:46.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.279299ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
117682024-11-25T19:41:46.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.34054ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
117692024-11-25T19:41:46.251ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1731, tv_nsec: 794630847 } })
117702024-11-25T19:41:46.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117712024-11-25T19:41:46.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
117722024-11-25T19:41:46.251ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117732024-11-25T19:41:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117742024-11-25T19:41:46.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117752024-11-25T19:41:46.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117762024-11-25T19:41:46.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.111064ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
117772024-11-25T19:41:46.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
117782024-11-25T19:41:46.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117792024-11-25T19:41:46.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117802024-11-25T19:41:46.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117812024-11-25T19:41:46.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117822024-11-25T19:41:46.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117832024-11-25T19:41:46.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
117842024-11-25T19:41:46.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117852024-11-25T19:41:46.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117862024-11-25T19:41:46.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117872024-11-25T19:41:46.258ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
117882024-11-25T19:41:46.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117892024-11-25T19:41:46.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
117902024-11-25T19:41:46.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117912024-11-25T19:41:46.260ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.800475ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
117922024-11-25T19:41:46.260ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
117932024-11-25T19:41:46.260ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 55.222163ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
117942024-11-25T19:41:46.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
117952024-11-25T19:41:46.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117962024-11-25T19:41:46.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117972024-11-25T19:41:46.264ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.537988ms iteration = 22 status = 0
117982024-11-25T19:41:46.280ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117992024-11-25T19:41:46.280ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
118002024-11-25T19:41:46.280ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118012024-11-25T19:41:46.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118022024-11-25T19:41:46.284ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
118032024-11-25T19:41:46.284ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118042024-11-25T19:41:46.284ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "caefbb7f-dd73-44a6-a6c8-ac0b5e63a0a1", "content-length": "26", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
118052024-11-25T19:41:46.284ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118062024-11-25T19:41:46.285ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118072024-11-25T19:41:46.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118082024-11-25T19:41:46.286ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118092024-11-25T19:41:46.304ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
118102024-11-25T19:41:46.304ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118112024-11-25T19:41:46.304ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cc50158-962b-414b-b597-17373cbd68c8", "content-length": "26", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
118122024-11-25T19:41:46.304ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118132024-11-25T19:41:46.307ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118142024-11-25T19:41:46.314ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118152024-11-25T19:41:46.314ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
118162024-11-25T19:41:46.314ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.619191ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
118172024-11-25T19:41:46.325ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118182024-11-25T19:41:46.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118192024-11-25T19:41:46.327ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.914862ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
118202024-11-25T19:41:46.339ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 133.678073ms iteration = 25 status = {"physical_disks_added":0}
118212024-11-25T19:41:46.399ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
118222024-11-25T19:41:46.400ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ab9744a-94bd-4e32-a711-95970cd09b71", "content-length": "1", "date": "Mon, 25 Nov 2024 19:41:45 GMT"} })
118232024-11-25T19:41:46.401ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
118242024-11-25T19:41:46.401ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118252024-11-25T19:41:46.402ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98c5d1ec-b9a7-46d6-bd56-13ff0b5211a7", "content-length": "26", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
118262024-11-25T19:41:46.402ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118272024-11-25T19:41:46.402ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
118282024-11-25T19:41:46.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118292024-11-25T19:41:46.403ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
118302024-11-25T19:41:46.430ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
118312024-11-25T19:41:46.430ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118322024-11-25T19:41:46.430ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1b10663-6571-4152-8250-7b49422d0315", "content-length": "372", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
118332024-11-25T19:41:46.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118342024-11-25T19:41:46.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118352024-11-25T19:41:46.432ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 226.964673ms iteration = 22 status = null
118362024-11-25T19:41:46.446ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 240.910187ms iteration = 22 status = {}
118372024-11-25T19:41:46.466ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118382024-11-25T19:41:46.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118392024-11-25T19:41:46.468ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118402024-11-25T19:41:46.469ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118412024-11-25T19:41:46.469ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118422024-11-25T19:41:46.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118432024-11-25T19:41:46.475ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
118442024-11-25T19:41:46.475ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
118452024-11-25T19:41:46.475ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3c88606f-c62f-4df5-b2fa-c73e30808b67", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
118462024-11-25T19:41:46.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118472024-11-25T19:41:46.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118482024-11-25T19:41:46.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118492024-11-25T19:41:46.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118502024-11-25T19:41:46.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118512024-11-25T19:41:46.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118522024-11-25T19:41:46.484ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
118532024-11-25T19:41:46.484ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118542024-11-25T19:41:46.484ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a913c3c3-737b-4916-bf9b-bb04059f5afa", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
118552024-11-25T19:41:46.486ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 280.955523ms iteration = 23 status = {}
118562024-11-25T19:41:46.496ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118572024-11-25T19:41:46.498ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118582024-11-25T19:41:46.498ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118592024-11-25T19:41:46.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118602024-11-25T19:41:46.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118612024-11-25T19:41:46.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118622024-11-25T19:41:46.525ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
118632024-11-25T19:41:46.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118642024-11-25T19:41:46.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118652024-11-25T19:41:46.533ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
118662024-11-25T19:41:46.533ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0db513ac-ae08-45d8-9e65-5365724b9b3f", "content-length": "134", "date": "Mon, 25 Nov 2024 19:41:45 GMT"} })
118672024-11-25T19:41:46.533ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
118682024-11-25T19:41:46.533ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
118692024-11-25T19:41:46.533ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
118702024-11-25T19:41:46.533ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
118712024-11-25T19:41:46.533ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118722024-11-25T19:41:46.533ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118732024-11-25T19:41:46.533ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118742024-11-25T19:41:46.533ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
118752024-11-25T19:41:46.534ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118762024-11-25T19:41:46.534ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
118772024-11-25T19:41:46.534ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
118782024-11-25T19:41:46.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118792024-11-25T19:41:46.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118802024-11-25T19:41:46.534ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
118812024-11-25T19:41:46.535ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "40fac408-726d-4250-bce4-506b972d2521", "content-length": "691", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
118822024-11-25T19:41:46.535ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
118832024-11-25T19:41:46.535ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
118842024-11-25T19:41:46.535ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
118852024-11-25T19:41:46.535ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
118862024-11-25T19:41:46.536ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "79c304c2-bf63-47c5-86a2-839fa95383e1", "content-length": "2", "date": "Mon, 25 Nov 2024 19:41:45 GMT"} })
118872024-11-25T19:41:46.536ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
118882024-11-25T19:41:46.536ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "02c00de3-7636-4507-9b14-a75e775379d6", "content-length": "51", "date": "Mon, 25 Nov 2024 19:41:45 GMT"} })
118892024-11-25T19:41:46.536ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
118902024-11-25T19:41:46.536ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
118912024-11-25T19:41:46.536ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 331.128447ms iteration = 22 status = {}
118922024-11-25T19:41:46.626ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2f402da6-47f9-4717-abcc-3a02918e1bee", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
118932024-11-25T19:41:46.626ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
118942024-11-25T19:41:46.626ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
118952024-11-25T19:41:46.626ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "80ee9407-98a6-4b34-bc0e-2261997d80fe", "content-length": "682", "date": "Mon, 25 Nov 2024 19:41:46 GMT"} })
118962024-11-25T19:41:46.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118972024-11-25T19:41:46.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118982024-11-25T19:41:46.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118992024-11-25T19:41:46.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119002024-11-25T19:41:46.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119012024-11-25T19:41:46.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119022024-11-25T19:41:46.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119032024-11-25T19:41:46.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119042024-11-25T19:41:46.642ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 437.423452ms iteration = 22 status = {}
119052024-11-25T19:41:47.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1142 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 9b59a8cf-58ed-496a-9ed7-cfc99fafdf38 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
119062024-11-25T19:41:56.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
119072024-11-25T19:41:56.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119082024-11-25T19:41:56.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
119092024-11-25T19:41:56.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119102024-11-25T19:41:56.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119112024-11-25T19:41:56.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119122024-11-25T19:41:56.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119132024-11-25T19:41:56.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119142024-11-25T19:41:56.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119152024-11-25T19:41:56.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119162024-11-25T19:41:56.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119172024-11-25T19:41:56.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119182024-11-25T19:41:56.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119192024-11-25T19:41:56.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
119202024-11-25T19:41:56.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119212024-11-25T19:41:56.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119222024-11-25T19:41:56.229ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
119232024-11-25T19:41:56.229ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.367998ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
119242024-11-25T19:41:56.234ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119252024-11-25T19:41:56.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119262024-11-25T19:41:56.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.005418ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119272024-11-25T19:41:57.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1429 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = fa443a06-0dc1-48b9-9fbc-80c7412d7ba3 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
119282024-11-25T19:42:06.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
119292024-11-25T19:42:06.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
119302024-11-25T19:42:06.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119312024-11-25T19:42:06.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119322024-11-25T19:42:06.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119332024-11-25T19:42:06.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119342024-11-25T19:42:06.207ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119352024-11-25T19:42:06.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119362024-11-25T19:42:06.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119372024-11-25T19:42:06.209ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.957977ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119382024-11-25T19:42:06.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119392024-11-25T19:42:06.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119402024-11-25T19:42:06.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119412024-11-25T19:42:06.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119422024-11-25T19:42:06.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119432024-11-25T19:42:06.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119442024-11-25T19:42:06.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
119452024-11-25T19:42:06.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119462024-11-25T19:42:06.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119472024-11-25T19:42:06.227ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
119482024-11-25T19:42:06.227ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.048653ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
119492024-11-25T19:42:06.417ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:49977
119502024-11-25T19:42:06.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49977 req_id = 8149a91f-7f5e-4f14-b1ff-7934609534da roles = RoleSet { roles: {} } uri = /metrics/producers
119512024-11-25T19:42:06.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49977 req_id = 8149a91f-7f5e-4f14-b1ff-7934609534da resource = Database result = Ok(()) uri = /metrics/producers
119522024-11-25T19:42:06.456ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = e1e4675c-73a5-46b5-9e0f-9d05cbba5670
119532024-11-25T19:42:06.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39045 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49977 req_id = 8149a91f-7f5e-4f14-b1ff-7934609534da response_code = 201 uri = /metrics/producers
119542024-11-25T19:42:07.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1274 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = bc6e1faa-bab1-46ff-bf93-179c97f5644e response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
119552024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
119562024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
119572024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
119582024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119592024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
119602024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
119612024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119622024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
119632024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
119642024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
119652024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119662024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119672024-11-25T19:42:16.206ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:32:16.206181444 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
119682024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
119692024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
119702024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
119712024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
119722024-11-25T19:42:16.206ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
119732024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
119742024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
119752024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
119762024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
119772024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
119782024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119792024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
119802024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
119812024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119822024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
119832024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
119842024-11-25T19:42:16.206ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
119852024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
119862024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119872024-11-25T19:42:16.206ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
119882024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
119892024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.571\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
119902024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119912024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
119922024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
119932024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
119942024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
119952024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119962024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
119972024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119982024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
119992024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
120002024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
120012024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
120022024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
120032024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
120042024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
120052024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
120062024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
120072024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
120082024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
120092024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
120102024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
120112024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120122024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
120132024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120142024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
120152024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
120162024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120172024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
120182024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120192024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
120202024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120212024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120222024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
120232024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
120242024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120252024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
120262024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
120272024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120282024-11-25T19:42:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120292024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120302024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
120312024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120322024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120332024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
120342024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120352024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
120362024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120372024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
120382024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
120392024-11-25T19:42:16.207ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1761, tv_nsec: 750324437 } })
120402024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
120412024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
120422024-11-25T19:42:16.207ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1761, tv_nsec: 750366438 } })
120432024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
120442024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.204184ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
120452024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
120462024-11-25T19:42:16.207ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.345006ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
120472024-11-25T19:42:16.208ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.121122ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
120482024-11-25T19:42:16.209ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120492024-11-25T19:42:16.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120502024-11-25T19:42:16.210ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.229653ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
120512024-11-25T19:42:16.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120522024-11-25T19:42:16.210ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120532024-11-25T19:42:16.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
120542024-11-25T19:42:16.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120552024-11-25T19:42:16.211ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.07679ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
120562024-11-25T19:42:16.211ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:32:16.206181444 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
120572024-11-25T19:42:16.211ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.479927ms iteration = 12 status = {"expiration":"2024-11-25T19:32:16.206181444Z","pruned":[]}
120582024-11-25T19:42:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
120592024-11-25T19:42:16.212ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120602024-11-25T19:42:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120612024-11-25T19:42:16.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120622024-11-25T19:42:16.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120632024-11-25T19:42:16.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120642024-11-25T19:42:16.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120652024-11-25T19:42:16.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120662024-11-25T19:42:16.216ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1761, tv_nsec: 759490487 } })
120672024-11-25T19:42:16.216ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120682024-11-25T19:42:16.216ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
120692024-11-25T19:42:16.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
120702024-11-25T19:42:16.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120712024-11-25T19:42:16.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120722024-11-25T19:42:16.220ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1761, tv_nsec: 763483796 } })
120732024-11-25T19:42:16.220ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
120742024-11-25T19:42:16.221ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120752024-11-25T19:42:16.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120762024-11-25T19:42:16.222ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120772024-11-25T19:42:16.222ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
120782024-11-25T19:42:16.222ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120792024-11-25T19:42:16.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120802024-11-25T19:42:16.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
120812024-11-25T19:42:16.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
120822024-11-25T19:42:16.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
120832024-11-25T19:42:16.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
120842024-11-25T19:42:16.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120852024-11-25T19:42:16.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120862024-11-25T19:42:16.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120872024-11-25T19:42:16.228ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120882024-11-25T19:42:16.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120892024-11-25T19:42:16.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
120902024-11-25T19:42:16.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120912024-11-25T19:42:16.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120922024-11-25T19:42:16.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120932024-11-25T19:42:16.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120942024-11-25T19:42:16.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1761, tv_nsec: 785802663 } })
120952024-11-25T19:42:16.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
120962024-11-25T19:42:16.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
120972024-11-25T19:42:16.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
120982024-11-25T19:42:16.251ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120992024-11-25T19:42:16.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
121002024-11-25T19:42:16.254ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
121012024-11-25T19:42:16.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
121022024-11-25T19:42:16.259ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
121032024-11-25T19:42:16.259ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
121042024-11-25T19:42:16.259ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 52.719674ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
121052024-11-25T19:42:16.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121062024-11-25T19:42:16.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
121072024-11-25T19:42:16.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121082024-11-25T19:42:16.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121092024-11-25T19:42:16.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121102024-11-25T19:42:16.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.601766ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
121112024-11-25T19:42:16.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
121122024-11-25T19:42:16.274ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121132024-11-25T19:42:16.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121142024-11-25T19:42:16.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121152024-11-25T19:42:16.276ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121162024-11-25T19:42:16.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
121172024-11-25T19:42:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121182024-11-25T19:42:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
121192024-11-25T19:42:16.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
121202024-11-25T19:42:16.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121212024-11-25T19:42:16.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121222024-11-25T19:42:16.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121232024-11-25T19:42:16.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121242024-11-25T19:42:16.280ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
121252024-11-25T19:42:16.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
121262024-11-25T19:42:16.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121272024-11-25T19:42:16.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121282024-11-25T19:42:16.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121292024-11-25T19:42:16.282ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.030682ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
121302024-11-25T19:42:16.282ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
121312024-11-25T19:42:16.282ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
121322024-11-25T19:42:16.282ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
121332024-11-25T19:42:16.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121342024-11-25T19:42:16.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121352024-11-25T19:42:16.283ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.045872ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121362024-11-25T19:42:16.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
121372024-11-25T19:42:16.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121382024-11-25T19:42:16.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121392024-11-25T19:42:16.285ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
121402024-11-25T19:42:16.286ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
121412024-11-25T19:42:16.286ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
121422024-11-25T19:42:16.286ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
121432024-11-25T19:42:16.286ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.640113ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
121442024-11-25T19:42:16.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
121452024-11-25T19:42:16.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
121462024-11-25T19:42:16.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121472024-11-25T19:42:16.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121482024-11-25T19:42:16.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121492024-11-25T19:42:16.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
121502024-11-25T19:42:16.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121512024-11-25T19:42:16.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121522024-11-25T19:42:16.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121532024-11-25T19:42:16.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
121542024-11-25T19:42:16.293ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121552024-11-25T19:42:16.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
121562024-11-25T19:42:16.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121572024-11-25T19:42:16.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121582024-11-25T19:42:16.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121592024-11-25T19:42:16.296ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
121602024-11-25T19:42:16.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
121612024-11-25T19:42:16.297ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.962075ms iteration = 23 status = 0
121622024-11-25T19:42:16.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121632024-11-25T19:42:16.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
121642024-11-25T19:42:16.304ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
121652024-11-25T19:42:16.304ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
121662024-11-25T19:42:16.304ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.85501ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
121672024-11-25T19:42:16.305ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
121682024-11-25T19:42:16.305ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.91667ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
121692024-11-25T19:42:16.314ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
121702024-11-25T19:42:16.314ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
121712024-11-25T19:42:16.314ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
121722024-11-25T19:42:16.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121732024-11-25T19:42:16.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121742024-11-25T19:42:16.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121752024-11-25T19:42:16.316ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 110.260884ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
121762024-11-25T19:42:16.316ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121772024-11-25T19:42:16.317ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
121782024-11-25T19:42:16.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
121792024-11-25T19:42:16.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121802024-11-25T19:42:16.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121812024-11-25T19:42:16.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
121822024-11-25T19:42:16.319ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121832024-11-25T19:42:16.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121842024-11-25T19:42:16.322ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121852024-11-25T19:42:16.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121862024-11-25T19:42:16.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121872024-11-25T19:42:16.325ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
121882024-11-25T19:42:16.325ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
121892024-11-25T19:42:16.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121902024-11-25T19:42:16.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
121912024-11-25T19:42:16.325ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121922024-11-25T19:42:16.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121932024-11-25T19:42:16.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121942024-11-25T19:42:16.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121952024-11-25T19:42:16.328ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
121962024-11-25T19:42:16.328ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
121972024-11-25T19:42:16.328ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.136266ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
121982024-11-25T19:42:16.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
121992024-11-25T19:42:16.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
122002024-11-25T19:42:16.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122012024-11-25T19:42:16.333ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
122022024-11-25T19:42:16.333ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
122032024-11-25T19:42:16.333ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
122042024-11-25T19:42:16.333ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 126.660245ms iteration = 13 status = {"generation":2}
122052024-11-25T19:42:16.347ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122062024-11-25T19:42:16.347ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.795172ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
122072024-11-25T19:42:16.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122082024-11-25T19:42:16.352ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
122092024-11-25T19:42:16.355ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122102024-11-25T19:42:16.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122112024-11-25T19:42:16.356ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
122122024-11-25T19:42:16.356ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122132024-11-25T19:42:16.356ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c924ad2a-ab2d-4184-bb2e-a6bbde1e248b", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
122142024-11-25T19:42:16.356ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122152024-11-25T19:42:16.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122162024-11-25T19:42:16.359ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122172024-11-25T19:42:16.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122182024-11-25T19:42:16.360ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122192024-11-25T19:42:16.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122202024-11-25T19:42:16.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122212024-11-25T19:42:16.361ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
122222024-11-25T19:42:16.361ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
122232024-11-25T19:42:16.361ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122242024-11-25T19:42:16.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122252024-11-25T19:42:16.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122262024-11-25T19:42:16.364ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122272024-11-25T19:42:16.364ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122282024-11-25T19:42:16.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122292024-11-25T19:42:16.366ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
122302024-11-25T19:42:16.366ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122312024-11-25T19:42:16.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122322024-11-25T19:42:16.368ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
122332024-11-25T19:42:16.368ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
122342024-11-25T19:42:16.368ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
122352024-11-25T19:42:16.368ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 162.611591ms iteration = 13 status = {"generation":1}
122362024-11-25T19:42:16.370ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
122372024-11-25T19:42:16.370ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 164.216272ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
122382024-11-25T19:42:16.389ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
122392024-11-25T19:42:16.389ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122402024-11-25T19:42:16.389ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e63ff9c-69af-43c8-9c2f-1db7eb3841ad", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
122412024-11-25T19:42:16.389ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122422024-11-25T19:42:16.391ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122432024-11-25T19:42:16.394ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
122442024-11-25T19:42:16.394ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 188.413377ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
122452024-11-25T19:42:16.402ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 195.940134ms iteration = 26 status = {"physical_disks_added":0}
122462024-11-25T19:42:16.427ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
122472024-11-25T19:42:16.427ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122482024-11-25T19:42:16.428ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7e39b61-5da0-41ab-9895-bd379e03b51d", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
122492024-11-25T19:42:16.428ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122502024-11-25T19:42:16.429ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
122512024-11-25T19:42:16.564ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
122522024-11-25T19:42:16.569ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 363.447111ms iteration = 23 status = {}
122532024-11-25T19:42:16.644ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
122542024-11-25T19:42:16.644ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "489fee2b-7eb5-4f56-99f2-e0a82a03ca81", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122552024-11-25T19:42:16.645ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122562024-11-25T19:42:16.646ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a4b142d3-a813-4a29-ac38-3dd6e6be7546", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122572024-11-25T19:42:16.646ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122582024-11-25T19:42:16.647ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122592024-11-25T19:42:16.648ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 441.467022ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
122602024-11-25T19:42:16.692ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
122612024-11-25T19:42:16.692ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "61c56d95-c6c0-491a-a41e-d9798501b426", "content-length": "691", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
122622024-11-25T19:42:16.692ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
122632024-11-25T19:42:16.692ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
122642024-11-25T19:42:16.692ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
122652024-11-25T19:42:16.693ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 487.344601ms iteration = 23 status = {}
122662024-11-25T19:42:16.712ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
122672024-11-25T19:42:16.713ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "95b96c89-0627-47d7-a8e6-0d32baa265ee", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
122682024-11-25T19:42:16.713ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
122692024-11-25T19:42:16.714ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5c7e8e2d-9321-40ef-90e5-a4d8dc7cca70", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
122702024-11-25T19:42:16.714ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
122712024-11-25T19:42:16.716ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7c1cdd92-50d0-4458-8fdb-3adda4a72073", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
122722024-11-25T19:42:16.716ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
122732024-11-25T19:42:16.717ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
122742024-11-25T19:42:16.717ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 511.434644ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
122752024-11-25T19:42:16.719ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
122762024-11-25T19:42:16.719ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
122772024-11-25T19:42:16.720ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d878f90-eb11-4989-b278-45abf15c8204", "content-length": "372", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
122782024-11-25T19:42:16.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122792024-11-25T19:42:16.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122802024-11-25T19:42:16.731ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
122812024-11-25T19:42:16.731ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8754b00c-708d-4066-9b78-0217b84dfdf1", "content-length": "1", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
122822024-11-25T19:42:16.733ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
122832024-11-25T19:42:16.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122842024-11-25T19:42:16.734ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 528.53843ms iteration = 23 status = null
122852024-11-25T19:42:16.759ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
122862024-11-25T19:42:16.759ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
122872024-11-25T19:42:16.759ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e8d55c8f-f8fd-421f-b1c6-2a2d4f18da6c", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
122882024-11-25T19:42:16.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122892024-11-25T19:42:16.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122902024-11-25T19:42:16.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122912024-11-25T19:42:16.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122922024-11-25T19:42:16.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122932024-11-25T19:42:16.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122942024-11-25T19:42:16.768ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
122952024-11-25T19:42:16.768ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
122962024-11-25T19:42:16.768ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fba31373-2f9d-4251-b6d6-4f1755d720bf", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
122972024-11-25T19:42:16.770ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 564.047427ms iteration = 24 status = {}
122982024-11-25T19:42:16.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122992024-11-25T19:42:16.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123002024-11-25T19:42:16.789ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
123012024-11-25T19:42:16.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123022024-11-25T19:42:16.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123032024-11-25T19:42:16.798ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
123042024-11-25T19:42:16.798ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6751dcf-a2a0-4062-94f6-95400260695c", "content-length": "134", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
123052024-11-25T19:42:16.798ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
123062024-11-25T19:42:16.798ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
123072024-11-25T19:42:16.799ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
123082024-11-25T19:42:16.799ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
123092024-11-25T19:42:16.799ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123102024-11-25T19:42:16.799ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123112024-11-25T19:42:16.799ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123122024-11-25T19:42:16.799ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123132024-11-25T19:42:16.799ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123142024-11-25T19:42:16.799ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123152024-11-25T19:42:16.799ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
123162024-11-25T19:42:16.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123172024-11-25T19:42:16.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123182024-11-25T19:42:16.801ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
123192024-11-25T19:42:16.802ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0acf2a7a-f323-473b-94f9-071db589da92", "content-length": "2", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
123202024-11-25T19:42:16.802ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
123212024-11-25T19:42:16.802ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e3b22c0-a7c7-425e-9d1a-57d470916a92", "content-length": "51", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
123222024-11-25T19:42:16.802ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
123232024-11-25T19:42:16.802ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
123242024-11-25T19:42:16.906ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8d80c5c0-9c6c-4171-9c22-90b07beb8d58", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
123252024-11-25T19:42:16.906ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
123262024-11-25T19:42:16.906ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
123272024-11-25T19:42:16.906ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "862a4f47-310b-4338-93c2-f8f5905eac9a", "content-length": "682", "date": "Mon, 25 Nov 2024 19:42:16 GMT"} })
123282024-11-25T19:42:16.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123292024-11-25T19:42:16.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123302024-11-25T19:42:16.912ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123312024-11-25T19:42:16.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123322024-11-25T19:42:16.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123332024-11-25T19:42:16.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123342024-11-25T19:42:16.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123352024-11-25T19:42:16.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123362024-11-25T19:42:16.929ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 723.21435ms iteration = 23 status = {}
123372024-11-25T19:42:17.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1556 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 0a2b9ac9-5425-469d-bde5-f0643911a2d1 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
123382024-11-25T19:42:17.859ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41177
123392024-11-25T19:42:17.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41177 req_id = b4ff37ab-dea4-43f4-9486-53ebe0b69711 roles = RoleSet { roles: {} } uri = /metrics/producers
123402024-11-25T19:42:17.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41177 req_id = b4ff37ab-dea4-43f4-9486-53ebe0b69711 resource = Database result = Ok(()) uri = /metrics/producers
123412024-11-25T19:42:17.894ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = d2d29ac8-9dfa-4f1f-be62-a88a71a6b2fa
123422024-11-25T19:42:17.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35115 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41177 req_id = b4ff37ab-dea4-43f4-9486-53ebe0b69711 response_code = 201 uri = /metrics/producers
123432024-11-25T19:42:23.811ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38741
123442024-11-25T19:42:23.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38741 req_id = 8edca227-341a-4a60-8f3d-7249a26ce63c roles = RoleSet { roles: {} } uri = /metrics/producers
123452024-11-25T19:42:23.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38741 req_id = 8edca227-341a-4a60-8f3d-7249a26ce63c resource = Database result = Ok(()) uri = /metrics/producers
123462024-11-25T19:42:23.848ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 4626c149-3efd-47ab-bfa7-bdd3e9545fef
123472024-11-25T19:42:23.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36721 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38741 req_id = 8edca227-341a-4a60-8f3d-7249a26ce63c response_code = 201 uri = /metrics/producers
123482024-11-25T19:42:26.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
123492024-11-25T19:42:26.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
123502024-11-25T19:42:26.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123512024-11-25T19:42:26.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123522024-11-25T19:42:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123532024-11-25T19:42:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123542024-11-25T19:42:26.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123552024-11-25T19:42:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123562024-11-25T19:42:26.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123572024-11-25T19:42:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123582024-11-25T19:42:26.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123592024-11-25T19:42:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123602024-11-25T19:42:26.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123612024-11-25T19:42:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123622024-11-25T19:42:26.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123632024-11-25T19:42:26.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
123642024-11-25T19:42:26.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123652024-11-25T19:42:26.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123662024-11-25T19:42:26.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.120702ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123672024-11-25T19:42:26.291ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
123682024-11-25T19:42:26.291ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.763543ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
123692024-11-25T19:42:27.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1271 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 36ff3dca-6fc4-48c2-a5d5-4b3bd7e658cf response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
123702024-11-25T19:42:36.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
123712024-11-25T19:42:36.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
123722024-11-25T19:42:36.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123732024-11-25T19:42:36.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123742024-11-25T19:42:36.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123752024-11-25T19:42:36.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123762024-11-25T19:42:36.208ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123772024-11-25T19:42:36.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123782024-11-25T19:42:36.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123792024-11-25T19:42:36.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123802024-11-25T19:42:36.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123812024-11-25T19:42:36.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123822024-11-25T19:42:36.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123832024-11-25T19:42:36.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123842024-11-25T19:42:36.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123852024-11-25T19:42:36.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
123862024-11-25T19:42:36.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123872024-11-25T19:42:36.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123882024-11-25T19:42:36.232ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
123892024-11-25T19:42:36.232ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.964109ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
123902024-11-25T19:42:36.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.320813ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123912024-11-25T19:42:37.280ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:50192
123922024-11-25T19:42:37.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 4ea3f01c-8eb1-429b-99e6-88b81cfda765 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
123932024-11-25T19:42:37.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 4ea3f01c-8eb1-429b-99e6-88b81cfda765 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
123942024-11-25T19:42:37.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 4ea3f01c-8eb1-429b-99e6-88b81cfda765 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
123952024-11-25T19:42:37.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 78613ce3-c443-4d3a-8e71-083473898a59 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
123962024-11-25T19:42:37.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 78613ce3-c443-4d3a-8e71-083473898a59 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
123972024-11-25T19:42:37.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 78613ce3-c443-4d3a-8e71-083473898a59 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
123982024-11-25T19:42:37.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1203 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 3f62f414-9c76-44e7-b97b-3d4b4ca1bcd2 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
123992024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
124002024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
124012024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124022024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
124032024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
124042024-11-25T19:42:46.205ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
124052024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
124062024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
124072024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124082024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
124092024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124102024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
124112024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124122024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
124132024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
124142024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
124152024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
124162024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
124172024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124182024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
124192024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
124202024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
124212024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
124222024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
124232024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
124242024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124252024-11-25T19:42:46.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124262024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
124272024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
124282024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
124292024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
124302024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
124312024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124322024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
124332024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
124342024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
124352024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124362024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
124372024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124382024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124392024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
124402024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124412024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
124422024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
124432024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124442024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
124452024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124462024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124472024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
124482024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
124492024-11-25T19:42:46.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
124502024-11-25T19:42:46.209ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1791, tv_nsec: 752698424 } })
124512024-11-25T19:42:46.209ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.839056ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
124522024-11-25T19:42:46.210ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
124532024-11-25T19:42:46.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124542024-11-25T19:42:46.212ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
124552024-11-25T19:42:46.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124562024-11-25T19:42:46.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124572024-11-25T19:42:46.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124582024-11-25T19:42:46.214ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1791, tv_nsec: 757717612 } })
124592024-11-25T19:42:46.214ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
124602024-11-25T19:42:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
124612024-11-25T19:42:46.217ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124622024-11-25T19:42:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124632024-11-25T19:42:46.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124642024-11-25T19:42:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124652024-11-25T19:42:46.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124662024-11-25T19:42:46.257ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124672024-11-25T19:42:46.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124682024-11-25T19:42:46.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124692024-11-25T19:42:46.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
124702024-11-25T19:42:46.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124712024-11-25T19:42:46.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124722024-11-25T19:42:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
124732024-11-25T19:42:46.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124742024-11-25T19:42:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124752024-11-25T19:42:46.260ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.434378ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
124762024-11-25T19:42:46.260ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124772024-11-25T19:42:46.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
124782024-11-25T19:42:46.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124792024-11-25T19:42:46.261ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
124802024-11-25T19:42:46.261ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
124812024-11-25T19:42:46.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
124822024-11-25T19:42:46.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124832024-11-25T19:42:46.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124842024-11-25T19:42:46.262ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1791, tv_nsec: 805160973 } })
124852024-11-25T19:42:46.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
124862024-11-25T19:42:46.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124872024-11-25T19:42:46.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124882024-11-25T19:42:46.262ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
124892024-11-25T19:42:46.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124902024-11-25T19:42:46.263ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
124912024-11-25T19:42:46.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
124922024-11-25T19:42:46.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124932024-11-25T19:42:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124942024-11-25T19:42:46.264ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124952024-11-25T19:42:46.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124962024-11-25T19:42:46.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124972024-11-25T19:42:46.267ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.825983ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
124982024-11-25T19:42:46.267ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
124992024-11-25T19:42:46.267ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125002024-11-25T19:42:46.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
125012024-11-25T19:42:46.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
125022024-11-25T19:42:46.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125032024-11-25T19:42:46.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125042024-11-25T19:42:46.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125052024-11-25T19:42:46.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125062024-11-25T19:42:46.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
125072024-11-25T19:42:46.269ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
125082024-11-25T19:42:46.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
125092024-11-25T19:42:46.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125102024-11-25T19:42:46.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
125112024-11-25T19:42:46.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125122024-11-25T19:42:46.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125132024-11-25T19:42:46.284ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
125142024-11-25T19:42:46.284ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125152024-11-25T19:42:46.284ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fda27a2e-0d67-4eb2-9916-f37e621476a5", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
125162024-11-25T19:42:46.284ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125172024-11-25T19:42:46.286ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125182024-11-25T19:42:46.287ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
125192024-11-25T19:42:46.287ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.880766ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
125202024-11-25T19:42:46.292ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
125212024-11-25T19:42:46.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
125222024-11-25T19:42:46.297ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.921253ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125232024-11-25T19:42:46.298ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125242024-11-25T19:42:46.298ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.901313ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
125252024-11-25T19:42:46.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
125262024-11-25T19:42:46.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125272024-11-25T19:42:46.301ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125282024-11-25T19:42:46.301ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
125292024-11-25T19:42:46.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125302024-11-25T19:42:46.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125312024-11-25T19:42:46.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
125322024-11-25T19:42:46.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.560994ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
125332024-11-25T19:42:46.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125342024-11-25T19:42:46.307ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
125352024-11-25T19:42:46.307ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125362024-11-25T19:42:46.308ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea0357e5-7e52-4594-bf3a-9162b94b1a12", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
125372024-11-25T19:42:46.308ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125382024-11-25T19:42:46.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
125392024-11-25T19:42:46.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125402024-11-25T19:42:46.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125412024-11-25T19:42:46.309ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125422024-11-25T19:42:46.311ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.435399ms iteration = 24 status = 0
125432024-11-25T19:42:46.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.309311ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
125442024-11-25T19:42:46.333ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125452024-11-25T19:42:46.333ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
125462024-11-25T19:42:46.333ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.694706ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
125472024-11-25T19:42:46.335ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125482024-11-25T19:42:46.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125492024-11-25T19:42:46.357ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
125502024-11-25T19:42:46.357ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125512024-11-25T19:42:46.357ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "42658517-375f-4014-9802-30846c80c1cc", "content-length": "26", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
125522024-11-25T19:42:46.357ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125532024-11-25T19:42:46.359ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
125542024-11-25T19:42:46.389ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 183.203855ms iteration = 27 status = {"physical_disks_added":0}
125552024-11-25T19:42:46.409ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 203.620035ms iteration = 24 status = {}
125562024-11-25T19:42:46.427ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125572024-11-25T19:42:46.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125582024-11-25T19:42:46.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125592024-11-25T19:42:46.431ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125602024-11-25T19:42:46.431ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125612024-11-25T19:42:46.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125622024-11-25T19:42:46.433ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125632024-11-25T19:42:46.434ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
125642024-11-25T19:42:46.434ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d6963e1-2dde-4c52-aa34-69ad8b9028dd", "content-length": "1", "date": "Mon, 25 Nov 2024 19:42:45 GMT"} })
125652024-11-25T19:42:46.434ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125662024-11-25T19:42:46.434ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125672024-11-25T19:42:46.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125682024-11-25T19:42:46.435ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
125692024-11-25T19:42:46.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
125702024-11-25T19:42:46.437ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 231.778968ms iteration = 24 status = null
125712024-11-25T19:42:46.480ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/40644ff1-5ecb-4152-92fd-205456a7f844/state
125722024-11-25T19:42:46.518ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
125732024-11-25T19:42:46.518ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
125742024-11-25T19:42:46.518ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "47d3277d-1edb-4f5e-ae40-2a299540150f", "content-length": "525", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
125752024-11-25T19:42:46.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125762024-11-25T19:42:46.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125772024-11-25T19:42:46.545ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
125782024-11-25T19:42:46.546ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0d6a3a3-b4c0-449b-9b80-b6ce6c57b0f1", "content-length": "811", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
125792024-11-25T19:42:46.546ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(14052216) }} sled = buskin
125802024-11-25T19:42:46.546ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
125812024-11-25T19:42:46.546ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
125822024-11-25T19:42:46.548ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 342.401068ms iteration = 24 status = {}
125832024-11-25T19:42:46.567ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {8d77fd96-7e85-482e-b197-592d80fc5793: {10.151.1.175: {15fc98e0-962c-43e7-8e4b-b9da5489f367}, 10.151.1.176: {15fc98e0-962c-43e7-8e4b-b9da5489f367}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
125842024-11-25T19:42:46.567ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
125852024-11-25T19:42:46.567ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b191b6da-fe60-49cb-b196-27c5c24e0251", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
125862024-11-25T19:42:46.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125872024-11-25T19:42:46.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125882024-11-25T19:42:46.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125892024-11-25T19:42:46.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125902024-11-25T19:42:46.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125912024-11-25T19:42:46.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125922024-11-25T19:42:46.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125932024-11-25T19:42:46.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125942024-11-25T19:42:46.577ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
125952024-11-25T19:42:46.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125962024-11-25T19:42:46.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125972024-11-25T19:42:46.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125982024-11-25T19:42:46.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125992024-11-25T19:42:46.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126002024-11-25T19:42:46.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126012024-11-25T19:42:46.581ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/40644ff1-5ecb-4152-92fd-205456a7f844/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a92714b-d7fe-418f-8059-d5ebab9f8971", "content-length": "131", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
126022024-11-25T19:42:46.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126032024-11-25T19:42:46.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126042024-11-25T19:42:46.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126052024-11-25T19:42:46.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126062024-11-25T19:42:46.587ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = b9902981-e922-4cfe-9602-2068a262a7ba sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-25T19:42:39.102674249Z }, migration_in: None, migration_out: None } vmm_id = 40644ff1-5ecb-4152-92fd-205456a7f844
126072024-11-25T19:42:46.587ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = b9902981-e922-4cfe-9602-2068a262a7ba migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 40644ff1-5ecb-4152-92fd-205456a7f844 sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b vmm_id = 40644ff1-5ecb-4152-92fd-205456a7f844 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-25T19:42:39.102674249Z }
126082024-11-25T19:42:46.587ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = b9902981-e922-4cfe-9602-2068a262a7ba roles = RoleSet { roles: {} } sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b vmm_id = 40644ff1-5ecb-4152-92fd-205456a7f844
126092024-11-25T19:42:46.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = b9902981-e922-4cfe-9602-2068a262a7ba resource = Database result = Ok(()) sled_id = 38711855-ef69-4d79-bb75-aebd85b1280b vmm_id = 40644ff1-5ecb-4152-92fd-205456a7f844
126102024-11-25T19:42:46.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126112024-11-25T19:42:46.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126122024-11-25T19:42:46.590ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
126132024-11-25T19:42:46.590ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b86c1863-0fc8-48b8-a659-462a20050b11", "content-length": "134", "date": "Mon, 25 Nov 2024 19:42:45 GMT"} })
126142024-11-25T19:42:46.590ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
126152024-11-25T19:42:46.590ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
126162024-11-25T19:42:46.591ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
126172024-11-25T19:42:46.591ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
126182024-11-25T19:42:46.591ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126192024-11-25T19:42:46.591ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126202024-11-25T19:42:46.591ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126212024-11-25T19:42:46.591ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126222024-11-25T19:42:46.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126232024-11-25T19:42:46.591ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126242024-11-25T19:42:46.591ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126252024-11-25T19:42:46.591ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
126262024-11-25T19:42:46.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126272024-11-25T19:42:46.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126282024-11-25T19:42:46.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126292024-11-25T19:42:46.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126302024-11-25T19:42:46.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126312024-11-25T19:42:46.594ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
126322024-11-25T19:42:46.595ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "54220635-6d9e-4034-9f28-d83a434dd5b8", "content-length": "2", "date": "Mon, 25 Nov 2024 19:42:45 GMT"} })
126332024-11-25T19:42:46.595ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
126342024-11-25T19:42:46.595ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf0c9eda-5b38-487c-bc1b-73ff4146ad9c", "content-length": "51", "date": "Mon, 25 Nov 2024 19:42:45 GMT"} })
126352024-11-25T19:42:46.595ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
126362024-11-25T19:42:46.595ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
126372024-11-25T19:42:46.595ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
126382024-11-25T19:42:46.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126392024-11-25T19:42:46.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126402024-11-25T19:42:46.597ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 391.123584ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
126412024-11-25T19:42:46.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126422024-11-25T19:42:46.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126432024-11-25T19:42:46.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126442024-11-25T19:42:46.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126452024-11-25T19:42:46.626ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:35803
126462024-11-25T19:42:46.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:35803 req_id = dea862ae-531e-46f2-85c6-f45588e859bf roles = RoleSet { roles: {} } uri = /metrics/producers
126472024-11-25T19:42:46.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:35803 req_id = dea862ae-531e-46f2-85c6-f45588e859bf resource = Database result = Ok(()) uri = /metrics/producers
126482024-11-25T19:42:46.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126492024-11-25T19:42:46.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b0ee39e3-ee2b-42ea-a096-0949e0c7b88f, lookup_type: ById(b0ee39e3-ee2b-42ea-a096-0949e0c7b88f) }, key: cfbeb897-a1ac-4a05-967e-598a6a4be566, lookup_type: ById(cfbeb897-a1ac-4a05-967e-598a6a4be566) }, key: 6b981b8a-dbf4-4924-b9eb-1acdbcd75373, lookup_type: ById(6b981b8a-dbf4-4924-b9eb-1acdbcd75373) } result = Ok(())
126502024-11-25T19:42:46.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126512024-11-25T19:42:46.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126522024-11-25T19:42:46.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126532024-11-25T19:42:46.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126542024-11-25T19:42:46.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126552024-11-25T19:42:46.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126562024-11-25T19:42:46.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126572024-11-25T19:42:46.651ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b0ee39e3-ee2b-42ea-a096-0949e0c7b88f, lookup_type: ById(b0ee39e3-ee2b-42ea-a096-0949e0c7b88f) }, key: cfbeb897-a1ac-4a05-967e-598a6a4be566, lookup_type: ById(cfbeb897-a1ac-4a05-967e-598a6a4be566) }, key: 6b981b8a-dbf4-4924-b9eb-1acdbcd75373, lookup_type: ById(6b981b8a-dbf4-4924-b9eb-1acdbcd75373) } result = Ok(())
126582024-11-25T19:42:46.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126592024-11-25T19:42:46.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126602024-11-25T19:42:46.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126612024-11-25T19:42:46.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126622024-11-25T19:42:46.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126632024-11-25T19:42:46.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126642024-11-25T19:42:46.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126652024-11-25T19:42:46.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126662024-11-25T19:42:46.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126672024-11-25T19:42:46.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126682024-11-25T19:42:46.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126692024-11-25T19:42:46.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126702024-11-25T19:42:46.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126712024-11-25T19:42:46.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126722024-11-25T19:42:46.689ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b9902981-e922-4cfe-9602-2068a262a7ba
126732024-11-25T19:42:46.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63356 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:35803 req_id = dea862ae-531e-46f2-85c6-f45588e859bf response_code = 201 uri = /metrics/producers
126742024-11-25T19:42:46.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126752024-11-25T19:42:46.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126762024-11-25T19:42:46.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126772024-11-25T19:42:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b0ee39e3-ee2b-42ea-a096-0949e0c7b88f, lookup_type: ById(b0ee39e3-ee2b-42ea-a096-0949e0c7b88f) }, key: cfbeb897-a1ac-4a05-967e-598a6a4be566, lookup_type: ById(cfbeb897-a1ac-4a05-967e-598a6a4be566) }, key: de585986-6dfc-477c-a7ff-dcdda121938f, lookup_type: ByName("default") } result = Ok(())
126782024-11-25T19:42:46.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126792024-11-25T19:42:46.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126802024-11-25T19:42:46.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126812024-11-25T19:42:46.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126822024-11-25T19:42:46.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126832024-11-25T19:42:46.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126842024-11-25T19:42:46.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126852024-11-25T19:42:46.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126862024-11-25T19:42:46.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126872024-11-25T19:42:46.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126882024-11-25T19:42:46.728ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7f36e8cf-cf9a-4539-a735-9630a3152df4", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
126892024-11-25T19:42:46.728ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
126902024-11-25T19:42:46.728ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
126912024-11-25T19:42:46.729ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "046f97c8-6d4f-4042-a4ad-95d4246c98f9", "content-length": "682", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
126922024-11-25T19:42:46.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126932024-11-25T19:42:46.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126942024-11-25T19:42:46.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126952024-11-25T19:42:46.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126962024-11-25T19:42:46.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126972024-11-25T19:42:46.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126982024-11-25T19:42:46.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126992024-11-25T19:42:46.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127002024-11-25T19:42:46.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127012024-11-25T19:42:46.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127022024-11-25T19:42:46.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127032024-11-25T19:42:46.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127042024-11-25T19:42:46.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127052024-11-25T19:42:46.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: d67475c9-87ae-4d90-9f64-ff01c1ac932d, lookup_type: ById(d67475c9-87ae-4d90-9f64-ff01c1ac932d) }, key: b0ee39e3-ee2b-42ea-a096-0949e0c7b88f, lookup_type: ById(b0ee39e3-ee2b-42ea-a096-0949e0c7b88f) }, key: cfbeb897-a1ac-4a05-967e-598a6a4be566, lookup_type: ById(cfbeb897-a1ac-4a05-967e-598a6a4be566) }, key: 15fc98e0-962c-43e7-8e4b-b9da5489f367, lookup_type: ByName("default") } result = Ok(())
127062024-11-25T19:42:46.744ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
127072024-11-25T19:42:46.744ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
127082024-11-25T19:42:46.745ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f3c04220-7711-4acc-8bbf-42b90a604ffc", "date": "Mon, 25 Nov 2024 19:42:46 GMT"} })
127092024-11-25T19:42:46.747ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 541.924453ms iteration = 25 status = {}
127102024-11-25T19:42:46.753ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 547.316919ms iteration = 24 status = {}
127112024-11-25T19:42:47.296ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3580 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = bc782622-17f8-4a96-bcef-ba9163faea99 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
127122024-11-25T19:42:52.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 4d79c024-948f-4c8e-9790-5a362e71287c roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
127132024-11-25T19:42:52.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 4d79c024-948f-4c8e-9790-5a362e71287c resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
127142024-11-25T19:42:52.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 4d79c024-948f-4c8e-9790-5a362e71287c response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
127152024-11-25T19:42:52.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 3de64421-9e10-4921-911f-3bea8f86290c roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
127162024-11-25T19:42:52.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 3de64421-9e10-4921-911f-3bea8f86290c resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
127172024-11-25T19:42:52.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 3de64421-9e10-4921-911f-3bea8f86290c response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
127182024-11-25T19:42:56.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
127192024-11-25T19:42:56.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127202024-11-25T19:42:56.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
127212024-11-25T19:42:56.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127222024-11-25T19:42:56.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127232024-11-25T19:42:56.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127242024-11-25T19:42:56.208ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127252024-11-25T19:42:56.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127262024-11-25T19:42:56.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127272024-11-25T19:42:56.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127282024-11-25T19:42:56.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127292024-11-25T19:42:56.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127302024-11-25T19:42:56.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127312024-11-25T19:42:56.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127322024-11-25T19:42:56.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127332024-11-25T19:42:56.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
127342024-11-25T19:42:56.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127352024-11-25T19:42:56.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127362024-11-25T19:42:56.228ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
127372024-11-25T19:42:56.228ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.172755ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
127382024-11-25T19:42:56.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.596241ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127392024-11-25T19:42:57.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1471 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 076f25d7-7f90-47fd-a6ba-dbc50ba3a7d9 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
127402024-11-25T19:43:06.205ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
127412024-11-25T19:43:06.205ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127422024-11-25T19:43:06.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
127432024-11-25T19:43:06.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127442024-11-25T19:43:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127452024-11-25T19:43:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127462024-11-25T19:43:06.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127472024-11-25T19:43:06.208ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127482024-11-25T19:43:06.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127492024-11-25T19:43:06.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127502024-11-25T19:43:06.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127512024-11-25T19:43:06.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127522024-11-25T19:43:06.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127532024-11-25T19:43:06.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127542024-11-25T19:43:06.238ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.422866ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127552024-11-25T19:43:06.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127562024-11-25T19:43:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
127572024-11-25T19:43:06.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127582024-11-25T19:43:06.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127592024-11-25T19:43:06.255ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
127602024-11-25T19:43:06.255ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.607103ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
127612024-11-25T19:43:07.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 5590e0ca-a25f-42f7-9d87-20cf8620985d roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
127622024-11-25T19:43:07.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 5590e0ca-a25f-42f7-9d87-20cf8620985d resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
127632024-11-25T19:43:07.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 5590e0ca-a25f-42f7-9d87-20cf8620985d response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
127642024-11-25T19:43:07.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 3837be90-5f9b-410a-bb00-8b1bc1d89fdf roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
127652024-11-25T19:43:07.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 3837be90-5f9b-410a-bb00-8b1bc1d89fdf resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
127662024-11-25T19:43:07.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 3837be90-5f9b-410a-bb00-8b1bc1d89fdf response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
127672024-11-25T19:43:07.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1156 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 1ced9cf6-d698-4683-89ba-55975b7bc1c9 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
127682024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
127692024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
127702024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127712024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
127722024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127732024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
127742024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
127752024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
127762024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127772024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
127782024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
127792024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
127802024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127812024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
127822024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
127832024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
127842024-11-25T19:43:16.206ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:33:16.206318976 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
127852024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
127862024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
127872024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
127882024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
127892024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127902024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
127912024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
127922024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
127932024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
127942024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127952024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
127962024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
127972024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
127982024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
127992024-11-25T19:43:16.206ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
128002024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128012024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.081\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
128022024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
128032024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
128042024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
128052024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
128062024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128072024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
128082024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
128092024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
128102024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
128112024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
128122024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128132024-11-25T19:43:16.206ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
128142024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
128152024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
128162024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
128172024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128182024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
128192024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
128202024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128212024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
128222024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
128232024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
128242024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
128252024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
128262024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
128272024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
128282024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
128292024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
128302024-11-25T19:43:16.206ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
128312024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128322024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128332024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128342024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128352024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
128362024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
128372024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
128382024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128392024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128402024-11-25T19:43:16.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128412024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
128422024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128432024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
128442024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
128452024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
128462024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128472024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128482024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
128492024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
128502024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128512024-11-25T19:43:16.207ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1821, tv_nsec: 749923859 } })
128522024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128532024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
128542024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
128552024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128562024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128572024-11-25T19:43:16.207ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1821, tv_nsec: 749959320 } })
128582024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
128592024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
128602024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128612024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128622024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128632024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128642024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128652024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128662024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
128672024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.319376ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
128682024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128692024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
128702024-11-25T19:43:16.207ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.352547ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
128712024-11-25T19:43:16.208ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128722024-11-25T19:43:16.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128732024-11-25T19:43:16.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128742024-11-25T19:43:16.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128752024-11-25T19:43:16.211ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:33:16.206318976 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
128762024-11-25T19:43:16.211ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.940887ms iteration = 13 status = {"expiration":"2024-11-25T19:33:16.206318976Z","pruned":[]}
128772024-11-25T19:43:16.211ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.190131ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
128782024-11-25T19:43:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
128792024-11-25T19:43:16.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128802024-11-25T19:43:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128812024-11-25T19:43:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
128822024-11-25T19:43:16.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128832024-11-25T19:43:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128842024-11-25T19:43:16.213ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128852024-11-25T19:43:16.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128862024-11-25T19:43:16.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128872024-11-25T19:43:16.215ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.261332ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
128882024-11-25T19:43:16.216ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128892024-11-25T19:43:16.216ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
128902024-11-25T19:43:16.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128912024-11-25T19:43:16.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128922024-11-25T19:43:16.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128932024-11-25T19:43:16.217ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128942024-11-25T19:43:16.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128952024-11-25T19:43:16.224ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128962024-11-25T19:43:16.225ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1821, tv_nsec: 768382372 } })
128972024-11-25T19:43:16.225ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
128982024-11-25T19:43:16.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
128992024-11-25T19:43:16.226ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
129002024-11-25T19:43:16.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
129012024-11-25T19:43:16.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129022024-11-25T19:43:16.230ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
129032024-11-25T19:43:16.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129042024-11-25T19:43:16.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129052024-11-25T19:43:16.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129062024-11-25T19:43:16.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129072024-11-25T19:43:16.233ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1821, tv_nsec: 776645334 } })
129082024-11-25T19:43:16.234ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
129092024-11-25T19:43:16.235ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129102024-11-25T19:43:16.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129112024-11-25T19:43:16.237ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129122024-11-25T19:43:16.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129132024-11-25T19:43:16.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1821, tv_nsec: 780655022 } })
129142024-11-25T19:43:16.238ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
129152024-11-25T19:43:16.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129162024-11-25T19:43:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129172024-11-25T19:43:16.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.364441ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
129182024-11-25T19:43:16.252ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129192024-11-25T19:43:16.253ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
129202024-11-25T19:43:16.253ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
129212024-11-25T19:43:16.253ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 46.649885ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
129222024-11-25T19:43:16.254ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129232024-11-25T19:43:16.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
129242024-11-25T19:43:16.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129252024-11-25T19:43:16.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129262024-11-25T19:43:16.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
129272024-11-25T19:43:16.256ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
129282024-11-25T19:43:16.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
129292024-11-25T19:43:16.258ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129302024-11-25T19:43:16.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129312024-11-25T19:43:16.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129322024-11-25T19:43:16.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129332024-11-25T19:43:16.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
129342024-11-25T19:43:16.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129352024-11-25T19:43:16.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129362024-11-25T19:43:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
129372024-11-25T19:43:16.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129382024-11-25T19:43:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129392024-11-25T19:43:16.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129402024-11-25T19:43:16.267ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
129412024-11-25T19:43:16.267ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.102049ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
129422024-11-25T19:43:16.268ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129432024-11-25T19:43:16.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129442024-11-25T19:43:16.268ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129452024-11-25T19:43:16.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
129462024-11-25T19:43:16.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129472024-11-25T19:43:16.271ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129482024-11-25T19:43:16.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129492024-11-25T19:43:16.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129502024-11-25T19:43:16.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.397653ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
129512024-11-25T19:43:16.273ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129522024-11-25T19:43:16.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129532024-11-25T19:43:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129542024-11-25T19:43:16.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
129552024-11-25T19:43:16.276ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129562024-11-25T19:43:16.276ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.528544ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
129572024-11-25T19:43:16.276ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129582024-11-25T19:43:16.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129592024-11-25T19:43:16.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
129602024-11-25T19:43:16.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129612024-11-25T19:43:16.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129622024-11-25T19:43:16.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
129632024-11-25T19:43:16.278ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129642024-11-25T19:43:16.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129652024-11-25T19:43:16.283ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129662024-11-25T19:43:16.283ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129672024-11-25T19:43:16.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129682024-11-25T19:43:16.284ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
129692024-11-25T19:43:16.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
129702024-11-25T19:43:16.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
129712024-11-25T19:43:16.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
129722024-11-25T19:43:16.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129732024-11-25T19:43:16.285ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129742024-11-25T19:43:16.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129752024-11-25T19:43:16.285ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129762024-11-25T19:43:16.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
129772024-11-25T19:43:16.287ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129782024-11-25T19:43:16.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
129792024-11-25T19:43:16.294ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
129802024-11-25T19:43:16.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
129812024-11-25T19:43:16.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.270502ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129822024-11-25T19:43:16.296ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 90.485085ms iteration = 6 status = {"nsuccess":5}
129832024-11-25T19:43:16.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129842024-11-25T19:43:16.300ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129852024-11-25T19:43:16.301ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
129862024-11-25T19:43:16.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129872024-11-25T19:43:16.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129882024-11-25T19:43:16.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
129892024-11-25T19:43:16.303ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
129902024-11-25T19:43:16.303ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.402551ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
129912024-11-25T19:43:16.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129922024-11-25T19:43:16.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129932024-11-25T19:43:16.309ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
129942024-11-25T19:43:16.309ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
129952024-11-25T19:43:16.309ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 102.776216ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
129962024-11-25T19:43:16.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129972024-11-25T19:43:16.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129982024-11-25T19:43:16.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129992024-11-25T19:43:16.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130002024-11-25T19:43:16.313ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
130012024-11-25T19:43:16.313ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
130022024-11-25T19:43:16.313ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
130032024-11-25T19:43:16.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130042024-11-25T19:43:16.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130052024-11-25T19:43:16.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130062024-11-25T19:43:16.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130072024-11-25T19:43:16.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
130082024-11-25T19:43:16.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130092024-11-25T19:43:16.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130102024-11-25T19:43:16.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130112024-11-25T19:43:16.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130122024-11-25T19:43:16.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130132024-11-25T19:43:16.319ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.785733ms iteration = 25 status = 0
130142024-11-25T19:43:16.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130152024-11-25T19:43:16.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130162024-11-25T19:43:16.324ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130172024-11-25T19:43:16.324ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 118.009125ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
130182024-11-25T19:43:16.324ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
130192024-11-25T19:43:16.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
130202024-11-25T19:43:16.326ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130212024-11-25T19:43:16.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130222024-11-25T19:43:16.327ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
130232024-11-25T19:43:16.327ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 120.871232ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
130242024-11-25T19:43:16.330ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130252024-11-25T19:43:16.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
130262024-11-25T19:43:16.332ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130272024-11-25T19:43:16.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130282024-11-25T19:43:16.333ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
130292024-11-25T19:43:16.333ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
130302024-11-25T19:43:16.333ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
130312024-11-25T19:43:16.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130322024-11-25T19:43:16.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130332024-11-25T19:43:16.335ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130342024-11-25T19:43:16.338ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
130352024-11-25T19:43:16.339ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130362024-11-25T19:43:16.339ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130372024-11-25T19:43:16.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130382024-11-25T19:43:16.341ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130392024-11-25T19:43:16.341ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
130402024-11-25T19:43:16.341ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 135.424287ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
130412024-11-25T19:43:16.342ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.158642ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
130422024-11-25T19:43:16.353ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
130432024-11-25T19:43:16.353ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130442024-11-25T19:43:16.353ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb3af46c-df64-4242-860d-1ad1937fcdab", "content-length": "26", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
130452024-11-25T19:43:16.353ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130462024-11-25T19:43:16.355ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
130472024-11-25T19:43:16.357ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
130482024-11-25T19:43:16.357ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
130492024-11-25T19:43:16.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130502024-11-25T19:43:16.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130512024-11-25T19:43:16.369ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
130522024-11-25T19:43:16.369ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 163.285513ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
130532024-11-25T19:43:16.370ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
130542024-11-25T19:43:16.370ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
130552024-11-25T19:43:16.370ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130562024-11-25T19:43:16.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130572024-11-25T19:43:16.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130582024-11-25T19:43:16.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130592024-11-25T19:43:16.392ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
130602024-11-25T19:43:16.392ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130612024-11-25T19:43:16.392ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6767f281-58af-46f3-a845-dd7a429729ef", "content-length": "26", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
130622024-11-25T19:43:16.392ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130632024-11-25T19:43:16.394ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
130642024-11-25T19:43:16.408ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
130652024-11-25T19:43:16.408ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130662024-11-25T19:43:16.408ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3cc240f-48ab-4d43-b910-d2a935b02202", "content-length": "26", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
130672024-11-25T19:43:16.409ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130682024-11-25T19:43:16.410ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
130692024-11-25T19:43:16.434ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 227.684967ms iteration = 28 status = {"physical_disks_added":0}
130702024-11-25T19:43:16.502ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
130712024-11-25T19:43:16.548ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
130722024-11-25T19:43:16.548ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4edc5e52-b3f6-4f0c-b11a-ae65a8050112", "content-length": "2", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
130732024-11-25T19:43:16.549ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
130742024-11-25T19:43:16.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
130752024-11-25T19:43:16.585ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
130762024-11-25T19:43:16.585ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0078fb6e-432a-458f-b092-0ca70d8d0ad3", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130772024-11-25T19:43:16.585ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130782024-11-25T19:43:16.586ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "44d794b7-d4f5-46d8-90fd-f7995c6a1105", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130792024-11-25T19:43:16.586ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130802024-11-25T19:43:16.588ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130812024-11-25T19:43:16.588ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 382.359032ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
130822024-11-25T19:43:16.629ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
130832024-11-25T19:43:16.629ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
130842024-11-25T19:43:16.629ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccec8f43-f017-41b1-95d0-0c2ccbd0f8e1", "content-length": "372", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
130852024-11-25T19:43:16.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130862024-11-25T19:43:16.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130872024-11-25T19:43:16.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130882024-11-25T19:43:16.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130892024-11-25T19:43:16.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130902024-11-25T19:43:16.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130912024-11-25T19:43:16.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130922024-11-25T19:43:16.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130932024-11-25T19:43:16.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130942024-11-25T19:43:16.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130952024-11-25T19:43:16.636ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 429.724571ms iteration = 25 status = null
130962024-11-25T19:43:16.637ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
130972024-11-25T19:43:16.637ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
130982024-11-25T19:43:16.637ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
130992024-11-25T19:43:16.637ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 431.404454ms iteration = 14 status = {"generation":2}
131002024-11-25T19:43:16.637ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
131012024-11-25T19:43:16.637ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
131022024-11-25T19:43:16.637ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
131032024-11-25T19:43:16.637ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 431.487386ms iteration = 14 status = {"generation":1}
131042024-11-25T19:43:16.641ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 434.641818ms iteration = 25 status = {}
131052024-11-25T19:43:16.644ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
131062024-11-25T19:43:16.644ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "cbb8861e-1404-49cd-9580-6b85213b5ff9", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131072024-11-25T19:43:16.644ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131082024-11-25T19:43:16.646ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4399ee19-0b8e-4260-a4bc-324753b1e233", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131092024-11-25T19:43:16.646ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131102024-11-25T19:43:16.648ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "dcecc785-87b7-4910-8fd4-bfcfaecfe952", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131112024-11-25T19:43:16.648ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131122024-11-25T19:43:16.650ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
131132024-11-25T19:43:16.650ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 443.644985ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
131142024-11-25T19:43:16.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131152024-11-25T19:43:16.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131162024-11-25T19:43:16.674ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
131172024-11-25T19:43:16.674ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
131182024-11-25T19:43:16.674ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a541e15f-bcf5-40a5-85dc-574dec435449", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131192024-11-25T19:43:16.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131202024-11-25T19:43:16.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131212024-11-25T19:43:16.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131222024-11-25T19:43:16.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131232024-11-25T19:43:16.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131242024-11-25T19:43:16.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131252024-11-25T19:43:16.682ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
131262024-11-25T19:43:16.683ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
131272024-11-25T19:43:16.683ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0790ba76-5e98-4d9b-8875-69e36802d8d7", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131282024-11-25T19:43:16.685ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 478.679822ms iteration = 26 status = {}
131292024-11-25T19:43:16.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131302024-11-25T19:43:16.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131312024-11-25T19:43:16.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131322024-11-25T19:43:16.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131332024-11-25T19:43:16.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131342024-11-25T19:43:16.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131352024-11-25T19:43:16.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131362024-11-25T19:43:16.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131372024-11-25T19:43:16.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131382024-11-25T19:43:16.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131392024-11-25T19:43:16.710ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
131402024-11-25T19:43:16.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131412024-11-25T19:43:16.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131422024-11-25T19:43:16.720ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
131432024-11-25T19:43:16.720ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "392abd03-24e3-4bcd-a162-20a5c64e5a34", "content-length": "134", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131442024-11-25T19:43:16.720ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
131452024-11-25T19:43:16.720ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
131462024-11-25T19:43:16.721ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
131472024-11-25T19:43:16.721ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
131482024-11-25T19:43:16.721ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131492024-11-25T19:43:16.721ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131502024-11-25T19:43:16.721ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131512024-11-25T19:43:16.721ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131522024-11-25T19:43:16.721ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131532024-11-25T19:43:16.721ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131542024-11-25T19:43:16.721ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
131552024-11-25T19:43:16.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131562024-11-25T19:43:16.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131572024-11-25T19:43:16.724ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
131582024-11-25T19:43:16.724ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b51f5f07-8891-4d73-9e1b-55a99788625f", "content-length": "2", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131592024-11-25T19:43:16.724ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
131602024-11-25T19:43:16.724ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3064353-b5ee-46ed-80f9-b25b6bfd2bf2", "content-length": "51", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131612024-11-25T19:43:16.724ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
131622024-11-25T19:43:16.724ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
131632024-11-25T19:43:16.781ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
131642024-11-25T19:43:16.805ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7b0bbd3f-7aa6-4d4f-8e5d-cc72dd3457ab", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131652024-11-25T19:43:16.805ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
131662024-11-25T19:43:16.805ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
131672024-11-25T19:43:16.805ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d999c6e-d4d7-44b1-bb84-931ea6adbb4e", "content-length": "682", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131682024-11-25T19:43:16.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131692024-11-25T19:43:16.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131702024-11-25T19:43:16.806ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f600ae99-a6b4-49b3-b4b9-1ac6b68c0d50", "content-length": "691", "date": "Mon, 25 Nov 2024 19:43:16 GMT"} })
131712024-11-25T19:43:16.806ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
131722024-11-25T19:43:16.806ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
131732024-11-25T19:43:16.806ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
131742024-11-25T19:43:16.807ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 601.108485ms iteration = 25 status = {}
131752024-11-25T19:43:16.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131762024-11-25T19:43:16.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131772024-11-25T19:43:16.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131782024-11-25T19:43:16.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131792024-11-25T19:43:16.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131802024-11-25T19:43:16.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131812024-11-25T19:43:16.822ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 615.956165ms iteration = 25 status = {}
131822024-11-25T19:43:17.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1129 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 08f47a69-912e-4c04-9911-523b62cd9fad response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
131832024-11-25T19:43:22.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 6c686e5c-61e2-47c6-9878-198c6b66031f roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
131842024-11-25T19:43:22.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 6c686e5c-61e2-47c6-9878-198c6b66031f resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
131852024-11-25T19:43:22.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 6c686e5c-61e2-47c6-9878-198c6b66031f response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
131862024-11-25T19:43:22.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 110b9b65-10d6-42dd-83bb-acafbcc5083e roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
131872024-11-25T19:43:22.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 110b9b65-10d6-42dd-83bb-acafbcc5083e resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
131882024-11-25T19:43:22.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 110b9b65-10d6-42dd-83bb-acafbcc5083e response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
131892024-11-25T19:43:26.205ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
131902024-11-25T19:43:26.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
131912024-11-25T19:43:26.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131922024-11-25T19:43:26.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131932024-11-25T19:43:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131942024-11-25T19:43:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131952024-11-25T19:43:26.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131962024-11-25T19:43:26.208ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131972024-11-25T19:43:26.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131982024-11-25T19:43:26.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
131992024-11-25T19:43:26.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132002024-11-25T19:43:26.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132012024-11-25T19:43:26.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132022024-11-25T19:43:26.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132032024-11-25T19:43:26.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132042024-11-25T19:43:26.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
132052024-11-25T19:43:26.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132062024-11-25T19:43:26.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132072024-11-25T19:43:26.228ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
132082024-11-25T19:43:26.228ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.606293ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
132092024-11-25T19:43:26.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.955287ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132102024-11-25T19:43:27.293ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1248 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 1b8bd5a0-b1cd-4af7-beea-61ade607e472 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
132112024-11-25T19:43:36.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
132122024-11-25T19:43:36.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132132024-11-25T19:43:36.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
132142024-11-25T19:43:36.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132152024-11-25T19:43:36.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132162024-11-25T19:43:36.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132172024-11-25T19:43:36.208ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132182024-11-25T19:43:36.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132192024-11-25T19:43:36.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132202024-11-25T19:43:36.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.078791ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132212024-11-25T19:43:36.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132222024-11-25T19:43:36.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132232024-11-25T19:43:36.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132242024-11-25T19:43:36.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132252024-11-25T19:43:36.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132262024-11-25T19:43:36.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132272024-11-25T19:43:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
132282024-11-25T19:43:36.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132292024-11-25T19:43:36.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132302024-11-25T19:43:36.252ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
132312024-11-25T19:43:36.252ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.923731ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
132322024-11-25T19:43:37.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1368 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 3f2f729b-fc5c-4fa4-b127-345a75c788cf response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
132332024-11-25T19:43:46.206ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
132342024-11-25T19:43:46.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132352024-11-25T19:43:46.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
132362024-11-25T19:43:46.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
132372024-11-25T19:43:46.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
132382024-11-25T19:43:46.206ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
132392024-11-25T19:43:46.206ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
132402024-11-25T19:43:46.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
132412024-11-25T19:43:46.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132422024-11-25T19:43:46.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
132432024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
132442024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
132452024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132462024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
132472024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
132482024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
132492024-11-25T19:43:46.207ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
132502024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
132512024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
132522024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132532024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
132542024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
132552024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
132562024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
132572024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
132582024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132592024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
132602024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132612024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
132622024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
132632024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132642024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
132652024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
132662024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
132672024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
132682024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132692024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132702024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
132712024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132722024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132732024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
132742024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
132752024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132762024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132772024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
132782024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
132792024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132802024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
132812024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
132822024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132832024-11-25T19:43:46.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
132842024-11-25T19:43:46.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132852024-11-25T19:43:46.210ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.461078ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
132862024-11-25T19:43:46.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132872024-11-25T19:43:46.210ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
132882024-11-25T19:43:46.210ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
132892024-11-25T19:43:46.210ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
132902024-11-25T19:43:46.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
132912024-11-25T19:43:46.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132922024-11-25T19:43:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132932024-11-25T19:43:46.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132942024-11-25T19:43:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132952024-11-25T19:43:46.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132962024-11-25T19:43:46.213ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1851, tv_nsec: 755877476 } })
132972024-11-25T19:43:46.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132982024-11-25T19:43:46.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132992024-11-25T19:43:46.213ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
133002024-11-25T19:43:46.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133012024-11-25T19:43:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
133022024-11-25T19:43:46.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133032024-11-25T19:43:46.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133042024-11-25T19:43:46.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133052024-11-25T19:43:46.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133062024-11-25T19:43:46.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133072024-11-25T19:43:46.217ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133082024-11-25T19:43:46.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133092024-11-25T19:43:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133102024-11-25T19:43:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
133112024-11-25T19:43:46.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
133122024-11-25T19:43:46.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
133132024-11-25T19:43:46.218ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
133142024-11-25T19:43:46.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
133152024-11-25T19:43:46.219ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1851, tv_nsec: 762102758 } })
133162024-11-25T19:43:46.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
133172024-11-25T19:43:46.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133182024-11-25T19:43:46.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133192024-11-25T19:43:46.221ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1851, tv_nsec: 764391663 } })
133202024-11-25T19:43:46.221ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.830311ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133212024-11-25T19:43:46.222ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133222024-11-25T19:43:46.222ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
133232024-11-25T19:43:46.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133242024-11-25T19:43:46.225ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133252024-11-25T19:43:46.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
133262024-11-25T19:43:46.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133272024-11-25T19:43:46.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133282024-11-25T19:43:46.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
133292024-11-25T19:43:46.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.670058ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
133302024-11-25T19:43:46.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
133312024-11-25T19:43:46.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.033644ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
133322024-11-25T19:43:46.254ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133332024-11-25T19:43:46.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
133342024-11-25T19:43:46.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133352024-11-25T19:43:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
133362024-11-25T19:43:46.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133372024-11-25T19:43:46.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133382024-11-25T19:43:46.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133392024-11-25T19:43:46.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133402024-11-25T19:43:46.264ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133412024-11-25T19:43:46.264ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
133422024-11-25T19:43:46.264ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
133432024-11-25T19:43:46.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
133442024-11-25T19:43:46.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133452024-11-25T19:43:46.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133462024-11-25T19:43:46.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133472024-11-25T19:43:46.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133482024-11-25T19:43:46.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133492024-11-25T19:43:46.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.075288ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
133502024-11-25T19:43:46.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
133512024-11-25T19:43:46.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133522024-11-25T19:43:46.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133532024-11-25T19:43:46.275ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
133542024-11-25T19:43:46.275ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.28154ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
133552024-11-25T19:43:46.285ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
133562024-11-25T19:43:46.285ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.199804ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
133572024-11-25T19:43:46.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133582024-11-25T19:43:46.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133592024-11-25T19:43:46.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133602024-11-25T19:43:46.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133612024-11-25T19:43:46.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.784155ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
133622024-11-25T19:43:46.290ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133632024-11-25T19:43:46.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
133642024-11-25T19:43:46.294ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133652024-11-25T19:43:46.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133662024-11-25T19:43:46.296ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.281082ms iteration = 26 status = 0
133672024-11-25T19:43:46.299ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133682024-11-25T19:43:46.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
133692024-11-25T19:43:46.307ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
133702024-11-25T19:43:46.308ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133712024-11-25T19:43:46.308ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a94fdb45-ef34-4721-967f-d402c3a5ca1e", "content-length": "26", "date": "Mon, 25 Nov 2024 19:43:46 GMT"} })
133722024-11-25T19:43:46.308ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133732024-11-25T19:43:46.310ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
133742024-11-25T19:43:46.311ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133752024-11-25T19:43:46.311ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
133762024-11-25T19:43:46.311ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.48466ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
133772024-11-25T19:43:46.326ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133782024-11-25T19:43:46.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133792024-11-25T19:43:46.327ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
133802024-11-25T19:43:46.327ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133812024-11-25T19:43:46.328ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fa75346-f149-4549-9882-0e58f284ee79", "content-length": "26", "date": "Mon, 25 Nov 2024 19:43:46 GMT"} })
133822024-11-25T19:43:46.328ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133832024-11-25T19:43:46.328ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
133842024-11-25T19:43:46.328ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133852024-11-25T19:43:46.328ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b251057-4f3e-44c3-bce3-84b9820346f5", "content-length": "26", "date": "Mon, 25 Nov 2024 19:43:46 GMT"} })
133862024-11-25T19:43:46.328ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133872024-11-25T19:43:46.330ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
133882024-11-25T19:43:46.331ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
133892024-11-25T19:43:46.334ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.572443ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
133902024-11-25T19:43:46.335ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 127.95916ms iteration = 29 status = {"physical_disks_added":0}
133912024-11-25T19:43:46.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133922024-11-25T19:43:46.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133932024-11-25T19:43:46.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133942024-11-25T19:43:46.417ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
133952024-11-25T19:43:46.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133962024-11-25T19:43:46.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133972024-11-25T19:43:46.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133982024-11-25T19:43:46.420ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
133992024-11-25T19:43:46.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134002024-11-25T19:43:46.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134012024-11-25T19:43:46.474ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
134022024-11-25T19:43:46.474ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
134032024-11-25T19:43:46.474ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f219005-4d03-49fb-ba8e-1f1479a95968", "content-length": "372", "date": "Mon, 25 Nov 2024 19:43:46 GMT"} })
134042024-11-25T19:43:46.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134052024-11-25T19:43:46.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134062024-11-25T19:43:46.491ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
134072024-11-25T19:43:46.491ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
134082024-11-25T19:43:46.491ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "86272581-d5bc-4c36-87e3-e1627f4def3f", "date": "Mon, 25 Nov 2024 19:43:46 GMT"} })
134092024-11-25T19:43:46.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134102024-11-25T19:43:46.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134112024-11-25T19:43:46.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134122024-11-25T19:43:46.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134132024-11-25T19:43:46.531ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
134142024-11-25T19:43:46.531ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4eb60287-f44b-4e4b-9955-b3b1775314b8", "content-length": "2", "date": "Mon, 25 Nov 2024 19:43:45 GMT"} })
134152024-11-25T19:43:46.533ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
134162024-11-25T19:43:46.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
134172024-11-25T19:43:46.551ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 344.192123ms iteration = 26 status = {}
134182024-11-25T19:43:46.624ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
134192024-11-25T19:43:46.624ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4e32811-b8af-488a-b083-008c40eda8b6", "content-length": "691", "date": "Mon, 25 Nov 2024 19:43:46 GMT"} })
134202024-11-25T19:43:46.624ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
134212024-11-25T19:43:46.624ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
134222024-11-25T19:43:46.624ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
134232024-11-25T19:43:46.625ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 418.636864ms iteration = 26 status = {}
134242024-11-25T19:43:46.626ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 419.078332ms iteration = 26 status = null
134252024-11-25T19:43:46.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134262024-11-25T19:43:46.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134272024-11-25T19:43:46.629ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
134282024-11-25T19:43:46.629ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
134292024-11-25T19:43:46.629ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "60d8dbd0-aacd-427e-9ef5-719e11997c6e", "date": "Mon, 25 Nov 2024 19:43:46 GMT"} })
134302024-11-25T19:43:46.632ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 425.219703ms iteration = 27 status = {}
134312024-11-25T19:43:46.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134322024-11-25T19:43:46.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134332024-11-25T19:43:46.662ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
134342024-11-25T19:43:46.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134352024-11-25T19:43:46.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134362024-11-25T19:43:46.670ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
134372024-11-25T19:43:46.670ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "51149629-322d-4ba4-a437-703015596825", "content-length": "134", "date": "Mon, 25 Nov 2024 19:43:46 GMT"} })
134382024-11-25T19:43:46.670ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
134392024-11-25T19:43:46.670ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
134402024-11-25T19:43:46.670ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
134412024-11-25T19:43:46.670ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
134422024-11-25T19:43:46.670ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134432024-11-25T19:43:46.670ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134442024-11-25T19:43:46.670ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134452024-11-25T19:43:46.670ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
134462024-11-25T19:43:46.670ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134472024-11-25T19:43:46.670ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
134482024-11-25T19:43:46.671ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
134492024-11-25T19:43:46.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134502024-11-25T19:43:46.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134512024-11-25T19:43:46.672ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
134522024-11-25T19:43:46.673ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d75d24e-e9dc-4d2d-9184-8eb9445209e6", "content-length": "2", "date": "Mon, 25 Nov 2024 19:43:46 GMT"} })
134532024-11-25T19:43:46.673ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
134542024-11-25T19:43:46.673ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8de81d44-3aaf-4ad9-b972-acec33005664", "content-length": "51", "date": "Mon, 25 Nov 2024 19:43:46 GMT"} })
134552024-11-25T19:43:46.673ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
134562024-11-25T19:43:46.673ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
134572024-11-25T19:43:46.759ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "688ec844-1f9c-45a6-bbd6-60bad0495f61", "date": "Mon, 25 Nov 2024 19:43:46 GMT"} })
134582024-11-25T19:43:46.759ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
134592024-11-25T19:43:46.759ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
134602024-11-25T19:43:46.759ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "db36914d-879e-4b35-9b6d-2e4f0aeee764", "content-length": "682", "date": "Mon, 25 Nov 2024 19:43:46 GMT"} })
134612024-11-25T19:43:46.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134622024-11-25T19:43:46.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134632024-11-25T19:43:46.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134642024-11-25T19:43:46.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134652024-11-25T19:43:46.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134662024-11-25T19:43:46.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134672024-11-25T19:43:46.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134682024-11-25T19:43:46.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134692024-11-25T19:43:46.778ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 571.154896ms iteration = 26 status = {}
134702024-11-25T19:43:47.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1118 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = a2a459d3-afa0-4cf8-8af2-65648087d51e response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
134712024-11-25T19:43:52.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 00b879a9-eac3-4ebc-a26b-e22740a0d25a roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
134722024-11-25T19:43:52.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 00b879a9-eac3-4ebc-a26b-e22740a0d25a resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
134732024-11-25T19:43:52.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2762 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 00b879a9-eac3-4ebc-a26b-e22740a0d25a response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
134742024-11-25T19:43:52.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 2f6f1c1c-f56c-405d-8297-eecda455918e roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
134752024-11-25T19:43:52.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 2f6f1c1c-f56c-405d-8297-eecda455918e resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
134762024-11-25T19:43:52.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 2f6f1c1c-f56c-405d-8297-eecda455918e response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
134772024-11-25T19:43:56.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
134782024-11-25T19:43:56.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
134792024-11-25T19:43:56.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134802024-11-25T19:43:56.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134812024-11-25T19:43:56.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134822024-11-25T19:43:56.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134832024-11-25T19:43:56.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134842024-11-25T19:43:56.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
134852024-11-25T19:43:56.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134862024-11-25T19:43:56.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134872024-11-25T19:43:56.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134882024-11-25T19:43:56.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134892024-11-25T19:43:56.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134902024-11-25T19:43:56.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
134912024-11-25T19:43:56.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134922024-11-25T19:43:56.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134932024-11-25T19:43:56.226ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
134942024-11-25T19:43:56.226ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.287238ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
134952024-11-25T19:43:56.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134962024-11-25T19:43:56.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134972024-11-25T19:43:56.263ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.159311ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
134982024-11-25T19:43:57.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1161 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 73305360-f4ca-4fae-acfe-c2503dd8bf34 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
134992024-11-25T19:43:58.856ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:53078
135002024-11-25T19:43:58.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53078 req_id = a451cbf7-8311-4463-8208-7ad824b388d9 roles = RoleSet { roles: {} } uri = /metrics/producers
135012024-11-25T19:43:58.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53078 req_id = a451cbf7-8311-4463-8208-7ad824b388d9 resource = Database result = Ok(()) uri = /metrics/producers
135022024-11-25T19:43:58.890ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 38711855-ef69-4d79-bb75-aebd85b1280b
135032024-11-25T19:43:58.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34547 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53078 req_id = a451cbf7-8311-4463-8208-7ad824b388d9 response_code = 201 uri = /metrics/producers
135042024-11-25T19:44:05.333ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
135052024-11-25T19:44:05.333ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
135062024-11-25T19:44:05.363ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
135072024-11-25T19:44:05.364ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:57076
135082024-11-25T19:44:05.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:57076 req_id = da3d8305-b84b-45f1-8a75-39137501deb9 roles = RoleSet { roles: {} } uri = /metrics/producers
135092024-11-25T19:44:05.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:57076 req_id = da3d8305-b84b-45f1-8a75-39137501deb9 resource = Database result = Ok(()) uri = /metrics/producers
135102024-11-25T19:44:05.400ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = 1d808376-6b5a-46f0-b373-d7ba578556eb
135112024-11-25T19:44:05.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36515 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:57076 req_id = da3d8305-b84b-45f1-8a75-39137501deb9 response_code = 201 uri = /metrics/producers
135122024-11-25T19:44:05.400ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "da3d8305-b84b-45f1-8a75-39137501deb9", "content-length": "41", "date": "Mon, 25 Nov 2024 19:44:05 GMT"} })
135132024-11-25T19:44:05.403ZDEBGnexus (producer-registration-task): registered with nexus successfully
135142024-11-25T19:44:05.403ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
135152024-11-25T19:44:06.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
135162024-11-25T19:44:06.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
135172024-11-25T19:44:06.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135182024-11-25T19:44:06.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135192024-11-25T19:44:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135202024-11-25T19:44:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135212024-11-25T19:44:06.208ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135222024-11-25T19:44:06.209ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135232024-11-25T19:44:06.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135242024-11-25T19:44:06.211ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.018348ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
135252024-11-25T19:44:06.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
135262024-11-25T19:44:06.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135272024-11-25T19:44:06.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135282024-11-25T19:44:06.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135292024-11-25T19:44:06.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135302024-11-25T19:44:06.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135312024-11-25T19:44:06.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
135322024-11-25T19:44:06.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135332024-11-25T19:44:06.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135342024-11-25T19:44:06.229ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
135352024-11-25T19:44:06.229ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.790587ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
135362024-11-25T19:44:07.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1229 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = fe42ae26-3338-4e76-b2b6-e48adcb3c05c response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
135372024-11-25T19:44:07.869ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34883
135382024-11-25T19:44:07.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34883 req_id = a38e8df9-d356-4e93-8fda-a9f4b332c63f roles = RoleSet { roles: {} } uri = /metrics/producers
135392024-11-25T19:44:07.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34883 req_id = a38e8df9-d356-4e93-8fda-a9f4b332c63f resource = Database result = Ok(()) uri = /metrics/producers
135402024-11-25T19:44:07.879ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b2b2b805-c910-42f7-8bd4-d5f05a06bed3
135412024-11-25T19:44:07.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10077 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34883 req_id = a38e8df9-d356-4e93-8fda-a9f4b332c63f response_code = 201 uri = /metrics/producers
135422024-11-25T19:44:13.389ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:62825
135432024-11-25T19:44:13.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62825 req_id = 4fc106d1-d7ad-4b58-9008-c052b67d142e roles = RoleSet { roles: {} } uri = /metrics/producers
135442024-11-25T19:44:13.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62825 req_id = 4fc106d1-d7ad-4b58-9008-c052b67d142e resource = Database result = Ok(()) uri = /metrics/producers
135452024-11-25T19:44:13.431ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = b59496f2-fc6d-46cb-9cf5-9b1a2e24358f
135462024-11-25T19:44:13.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42228 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62825 req_id = 4fc106d1-d7ad-4b58-9008-c052b67d142e response_code = 201 uri = /metrics/producers
135472024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
135482024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
135492024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135502024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
135512024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
135522024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
135532024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
135542024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
135552024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
135562024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
135572024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135582024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
135592024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135602024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
135612024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
135622024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
135632024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
135642024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
135652024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
135662024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
135672024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
135682024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
135692024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
135702024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
135712024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
135722024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
135732024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
135742024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
135752024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
135762024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
135772024-11-25T19:44:16.206ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-25 19:34:16.206521891 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
135782024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
135792024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
135802024-11-25T19:44:16.206ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
135812024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
135822024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
135832024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
135842024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
135852024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
135862024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
135872024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
135882024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
135892024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
135902024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
135912024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
135922024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
135932024-11-25T19:44:16.206ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
135942024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
135952024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135962024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
135972024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
135982024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
135992024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
136002024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
136012024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
136022024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
136032024-11-25T19:44:16.206ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c0042f8f-3059-4f90-9d41-8b34f2747978
136042024-11-25T19:44:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.931\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978"}
136052024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136062024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
136072024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
136082024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136092024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136102024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
136112024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
136122024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
136132024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
136142024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
136152024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136162024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136172024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
136182024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
136192024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
136202024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
136212024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
136222024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
136232024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
136242024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
136252024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136262024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
136272024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
136282024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
136292024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136302024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
136312024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136322024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
136332024-11-25T19:44:16.207ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64a08338-1eb5-49da-827e-ddea69a7943c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c588016e-a348-47f5-b498-43234ef44320.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dd4b9bd7-7dc8-4c50-b7a6-ad30d3af9195.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1881, tv_nsec: 749549542 } })
136342024-11-25T19:44:16.207ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5e357e48-2959-4886-8b9d-557b95c45fb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("6b3cbeea-c72e-481d-a7a1-e27c601ccb03.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1881, tv_nsec: 749585953 } })
136352024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
136362024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 954.798\u{b5}s iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
136372024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
136382024-11-25T19:44:16.207ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.216484ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
136392024-11-25T19:44:16.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136402024-11-25T19:44:16.210ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136412024-11-25T19:44:16.210ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.154151ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
136422024-11-25T19:44:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
136432024-11-25T19:44:16.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136442024-11-25T19:44:16.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136452024-11-25T19:44:16.212ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
136462024-11-25T19:44:16.212ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
136472024-11-25T19:44:16.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
136482024-11-25T19:44:16.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136492024-11-25T19:44:16.215ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1881, tv_nsec: 757704482 } })
136502024-11-25T19:44:16.215ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
136512024-11-25T19:44:16.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
136522024-11-25T19:44:16.217ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
136532024-11-25T19:44:16.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
136542024-11-25T19:44:16.218ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
136552024-11-25T19:44:16.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
136562024-11-25T19:44:16.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
136572024-11-25T19:44:16.220ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1881, tv_nsec: 762447665 } })
136582024-11-25T19:44:16.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
136592024-11-25T19:44:16.220ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
136602024-11-25T19:44:16.220ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136612024-11-25T19:44:16.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
136622024-11-25T19:44:16.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136632024-11-25T19:44:16.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136642024-11-25T19:44:16.222ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-25 19:34:16.206521891 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
136652024-11-25T19:44:16.222ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.912013ms iteration = 14 status = {"expiration":"2024-11-25T19:34:16.206521891Z","pruned":[]}
136662024-11-25T19:44:16.225ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.788269ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
136672024-11-25T19:44:16.226ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-38711855-ef69-4d79-bb75-aebd85b1280b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1881, tv_nsec: 768714508 } })
136682024-11-25T19:44:16.226ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
136692024-11-25T19:44:16.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
136702024-11-25T19:44:16.231ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
136712024-11-25T19:44:16.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
136722024-11-25T19:44:16.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
136732024-11-25T19:44:16.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136742024-11-25T19:44:16.235ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
136752024-11-25T19:44:16.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136762024-11-25T19:44:16.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136772024-11-25T19:44:16.237ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136782024-11-25T19:44:16.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
136792024-11-25T19:44:16.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
136802024-11-25T19:44:16.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
136812024-11-25T19:44:16.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.216078ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
136822024-11-25T19:44:16.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136832024-11-25T19:44:16.252ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136842024-11-25T19:44:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136852024-11-25T19:44:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
136862024-11-25T19:44:16.253ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
136872024-11-25T19:44:16.253ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
136882024-11-25T19:44:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
136892024-11-25T19:44:16.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
136902024-11-25T19:44:16.255ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
136912024-11-25T19:44:16.255ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
136922024-11-25T19:44:16.255ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 49.590773ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
136932024-11-25T19:44:16.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136942024-11-25T19:44:16.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
136952024-11-25T19:44:16.259ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136962024-11-25T19:44:16.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136972024-11-25T19:44:16.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136982024-11-25T19:44:16.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.128782ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
136992024-11-25T19:44:16.261ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
137002024-11-25T19:44:16.261ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
137012024-11-25T19:44:16.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
137022024-11-25T19:44:16.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137032024-11-25T19:44:16.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
137042024-11-25T19:44:16.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137052024-11-25T19:44:16.263ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137062024-11-25T19:44:16.265ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
137072024-11-25T19:44:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
137082024-11-25T19:44:16.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
137092024-11-25T19:44:16.266ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137102024-11-25T19:44:16.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
137112024-11-25T19:44:16.266ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
137122024-11-25T19:44:16.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
137132024-11-25T19:44:16.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137142024-11-25T19:44:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
137152024-11-25T19:44:16.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137162024-11-25T19:44:16.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137172024-11-25T19:44:16.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
137182024-11-25T19:44:16.272ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
137192024-11-25T19:44:16.272ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.416723ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
137202024-11-25T19:44:16.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137212024-11-25T19:44:16.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137222024-11-25T19:44:16.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137232024-11-25T19:44:16.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
137242024-11-25T19:44:16.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
137252024-11-25T19:44:16.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
137262024-11-25T19:44:16.276ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
137272024-11-25T19:44:16.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
137282024-11-25T19:44:16.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137292024-11-25T19:44:16.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
137302024-11-25T19:44:16.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137312024-11-25T19:44:16.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137322024-11-25T19:44:16.290ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
137332024-11-25T19:44:16.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
137342024-11-25T19:44:16.300ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
137352024-11-25T19:44:16.300ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.085326ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
137362024-11-25T19:44:16.301ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.33703ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
137372024-11-25T19:44:16.301ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
137382024-11-25T19:44:16.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
137392024-11-25T19:44:16.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 97.124645ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
137402024-11-25T19:44:16.304ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
137412024-11-25T19:44:16.304ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
137422024-11-25T19:44:16.304ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
137432024-11-25T19:44:16.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
137442024-11-25T19:44:16.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
137452024-11-25T19:44:16.304ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
137462024-11-25T19:44:16.304ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
137472024-11-25T19:44:16.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
137482024-11-25T19:44:16.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
137492024-11-25T19:44:16.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137502024-11-25T19:44:16.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137512024-11-25T19:44:16.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
137522024-11-25T19:44:16.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
137532024-11-25T19:44:16.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
137542024-11-25T19:44:16.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137552024-11-25T19:44:16.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
137562024-11-25T19:44:16.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137572024-11-25T19:44:16.309ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137582024-11-25T19:44:16.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.092623ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
137592024-11-25T19:44:16.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137602024-11-25T19:44:16.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
137612024-11-25T19:44:16.311ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
137622024-11-25T19:44:16.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
137632024-11-25T19:44:16.312ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
137642024-11-25T19:44:16.312ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
137652024-11-25T19:44:16.312ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 106.431458ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
137662024-11-25T19:44:16.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 38711855-ef69-4d79-bb75-aebd85b1280b, lookup_type: ById(38711855-ef69-4d79-bb75-aebd85b1280b) } result = Ok(())
137672024-11-25T19:44:16.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137682024-11-25T19:44:16.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137692024-11-25T19:44:16.315ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
137702024-11-25T19:44:16.315ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
137712024-11-25T19:44:16.315ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
137722024-11-25T19:44:16.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
137732024-11-25T19:44:16.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
137742024-11-25T19:44:16.315ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.355566ms iteration = 27 status = 0
137752024-11-25T19:44:16.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137762024-11-25T19:44:16.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
137772024-11-25T19:44:16.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
137782024-11-25T19:44:16.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
137792024-11-25T19:44:16.322ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 115.914715ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
137802024-11-25T19:44:16.326ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
137812024-11-25T19:44:16.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
137822024-11-25T19:44:16.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137832024-11-25T19:44:16.329ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
137842024-11-25T19:44:16.329ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
137852024-11-25T19:44:16.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
137862024-11-25T19:44:16.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137872024-11-25T19:44:16.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
137882024-11-25T19:44:16.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
137892024-11-25T19:44:16.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
137902024-11-25T19:44:16.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137912024-11-25T19:44:16.336ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
137922024-11-25T19:44:16.339ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
137932024-11-25T19:44:16.339ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
137942024-11-25T19:44:16.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
137952024-11-25T19:44:16.348ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
137962024-11-25T19:44:16.348ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
137972024-11-25T19:44:16.348ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.464826ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
137982024-11-25T19:44:16.358ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
137992024-11-25T19:44:16.358ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 0 version = 2
138002024-11-25T19:44:16.358ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
138012024-11-25T19:44:16.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
138022024-11-25T19:44:16.360ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
138032024-11-25T19:44:16.360ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-25T19:31:14.882604Z, time_modified: 2024-11-25T19:31:14.882604Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, db_silo: Silo { identity: SiloIdentity { id: d67475c9-87ae-4d90-9f64-ff01c1ac932d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-25T19:31:33.800301Z, time_modified: 2024-11-25T19:31:33.800301Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f" }] }) }
138042024-11-25T19:44:16.360ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 154.056073ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]}},"default_endpoint":{"silo_id":"d67475c9-87ae-4d90-9f64-ff01c1ac932d","tls_certs":["6fcfa1fce3d9774fddc3c524bcd094b59a2bb6df2ccec64025723c89a524bf6f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
138052024-11-25T19:44:16.375ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c zone_address = fd00:1122:3344:101::2
138062024-11-25T19:44:16.375ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
138072024-11-25T19:44:16.376ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f378d0d2-11c8-4e6b-82a0-61e511f55ced", "content-length": "26", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
138082024-11-25T19:44:16.376ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
138092024-11-25T19:44:16.378ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
138102024-11-25T19:44:16.378ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
138112024-11-25T19:44:16.378ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 172.012595ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
138122024-11-25T19:44:16.382ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 175.720487ms iteration = 30 status = {"physical_disks_added":0}
138132024-11-25T19:44:16.397ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
138142024-11-25T19:44:16.397ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
138152024-11-25T19:44:16.397ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6abe52c1-a0e4-41aa-beee-d0fd7d71d1a7", "content-length": "26", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
138162024-11-25T19:44:16.397ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
138172024-11-25T19:44:16.400ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
138182024-11-25T19:44:16.405ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
138192024-11-25T19:44:16.405ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
138202024-11-25T19:44:16.405ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebb1b53b-32c9-4f56-88a2-b8060b184987", "content-length": "26", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
138212024-11-25T19:44:16.405ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
138222024-11-25T19:44:16.407ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
138232024-11-25T19:44:16.498ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
138242024-11-25T19:44:16.498ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b2471fab-7de9-468a-ac40-1933c46b0254", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
138252024-11-25T19:44:16.498ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
138262024-11-25T19:44:16.499ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3f75de0c-c750-4698-9130-dc1ef2865afc", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
138272024-11-25T19:44:16.499ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
138282024-11-25T19:44:16.503ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
138292024-11-25T19:44:16.503ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 296.563938ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
138302024-11-25T19:44:16.530ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
138312024-11-25T19:44:16.531ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5759b1f-2eb2-4e75-a6cc-8643ccacc8d2", "content-length": "691", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
138322024-11-25T19:44:16.531ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
138332024-11-25T19:44:16.531ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
138342024-11-25T19:44:16.531ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
138352024-11-25T19:44:16.533ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 326.613948ms iteration = 27 status = {}
138362024-11-25T19:44:16.535ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
138372024-11-25T19:44:16.535ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
138382024-11-25T19:44:16.535ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "93ea43b8-e1f8-4969-805d-44841174e961", "content-length": "372", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
138392024-11-25T19:44:16.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138402024-11-25T19:44:16.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138412024-11-25T19:44:16.549ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
138422024-11-25T19:44:16.557ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
138432024-11-25T19:44:16.557ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "89737de6-12f0-4529-a2a5-cef3d5da7f2e", "content-length": "2", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
138442024-11-25T19:44:16.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
138452024-11-25T19:44:16.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
138462024-11-25T19:44:16.561ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 355.304291ms iteration = 27 status = null
138472024-11-25T19:44:16.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138482024-11-25T19:44:16.565ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 358.619957ms iteration = 27 status = {}
138492024-11-25T19:44:16.566ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
138502024-11-25T19:44:16.566ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
138512024-11-25T19:44:16.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
138522024-11-25T19:44:16.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
138532024-11-25T19:44:16.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
138542024-11-25T19:44:16.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
138552024-11-25T19:44:16.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
138562024-11-25T19:44:16.567ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138572024-11-25T19:44:16.569ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3574e73-f723-4b7b-8fbc-c2ef2147b146 dns_zone_name = oxide.test found_so_far = 1 version = 2
138582024-11-25T19:44:16.569ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
138592024-11-25T19:44:16.569ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-25 19:31:33.875455 UTC dns_group = external generation = 2
138602024-11-25T19:44:16.569ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 362.459192ms iteration = 15 status = {"generation":2}
138612024-11-25T19:44:16.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
138622024-11-25T19:44:16.570ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
138632024-11-25T19:44:16.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
138642024-11-25T19:44:16.572ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 35b386fb-c9a2-4840-83a6-f51d546b95eb dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
138652024-11-25T19:44:16.572ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
138662024-11-25T19:44:16.572ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-25 19:31:32.998430 UTC dns_group = internal generation = 1
138672024-11-25T19:44:16.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 366.198745ms iteration = 15 status = {"generation":1}
138682024-11-25T19:44:16.578ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
138692024-11-25T19:44:16.578ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
138702024-11-25T19:44:16.579ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a14f206f-867d-4f65-81c3-2f8c59e405f3", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
138712024-11-25T19:44:16.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138722024-11-25T19:44:16.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138732024-11-25T19:44:16.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138742024-11-25T19:44:16.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138752024-11-25T19:44:16.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138762024-11-25T19:44:16.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138772024-11-25T19:44:16.587ZINFOnexus (BackgroundTasks): VPC route manager sled 38711855-ef69-4d79-bb75-aebd85b1280b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
138782024-11-25T19:44:16.587ZDEBGnexus (BackgroundTasks): client request SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
138792024-11-25T19:44:16.588ZDEBGnexus (BackgroundTasks): client response SledAgent = 38711855-ef69-4d79-bb75-aebd85b1280b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "94a176b5-5b03-47ef-ae0e-a7b5af53dfdc", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
138802024-11-25T19:44:16.590ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 383.835271ms iteration = 28 status = {}
138812024-11-25T19:44:16.595ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
138822024-11-25T19:44:16.596ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "41c00ec2-8b64-4174-b686-119c8567c915", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
138832024-11-25T19:44:16.596ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
138842024-11-25T19:44:16.597ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "524039fd-0195-4b34-8de5-c26e97e34853", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
138852024-11-25T19:44:16.597ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
138862024-11-25T19:44:16.599ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d9410885-73b5-4503-a09e-77c21a4b3845", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
138872024-11-25T19:44:16.599ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
138882024-11-25T19:44:16.600ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
138892024-11-25T19:44:16.600ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 394.431368ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
138902024-11-25T19:44:16.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138912024-11-25T19:44:16.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138922024-11-25T19:44:16.631ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2e249f06-3416-4275-888a-76614319b621, rack_id: bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(111a6e41-2e2f-4080-81e6-0ac1b23b9f34) } rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
138932024-11-25T19:44:16.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138942024-11-25T19:44:16.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138952024-11-25T19:44:16.640ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
138962024-11-25T19:44:16.640ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7439cce9-ecfc-498b-b66b-67f9ac7d660d", "content-length": "134", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
138972024-11-25T19:44:16.640ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
138982024-11-25T19:44:16.640ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 111a6e41-2e2f-4080-81e6-0ac1b23b9f34
138992024-11-25T19:44:16.641ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
139002024-11-25T19:44:16.641ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
139012024-11-25T19:44:16.641ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139022024-11-25T19:44:16.641ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139032024-11-25T19:44:16.641ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139042024-11-25T19:44:16.641ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
139052024-11-25T19:44:16.641ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139062024-11-25T19:44:16.641ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
139072024-11-25T19:44:16.641ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c
139082024-11-25T19:44:16.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139092024-11-25T19:44:16.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139102024-11-25T19:44:16.643ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
139112024-11-25T19:44:16.643ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a2902ca-45c4-4f1a-be8a-c71104f1de90", "content-length": "2", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
139122024-11-25T19:44:16.643ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
139132024-11-25T19:44:16.643ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d54a778-0d89-4d16-970c-b2195220912a", "content-length": "51", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
139142024-11-25T19:44:16.643ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch_location = Switch0
139152024-11-25T19:44:16.643ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
139162024-11-25T19:44:16.732ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2809e5f7-44b9-4639-ade3-6513e6df50d5", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
139172024-11-25T19:44:16.732ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c switch = Switch0
139182024-11-25T19:44:16.732ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
139192024-11-25T19:44:16.733ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = bb9b4ef4-5e5c-465c-9ba4-9142d7b6e94c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2baca329-8aea-4e3d-936b-79730afda99d", "content-length": "682", "date": "Mon, 25 Nov 2024 19:44:16 GMT"} })
139202024-11-25T19:44:16.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139212024-11-25T19:44:16.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139222024-11-25T19:44:16.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139232024-11-25T19:44:16.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139242024-11-25T19:44:16.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139252024-11-25T19:44:16.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139262024-11-25T19:44:16.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139272024-11-25T19:44:16.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139282024-11-25T19:44:16.751ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 545.001533ms iteration = 27 status = {}
139292024-11-25T19:44:17.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1537 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 418b78a0-038f-410f-bf94-4e394b3e3ee2 response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
139302024-11-25T19:44:22.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 5d87e951-c4fa-422f-9724-f80d1a2d5b81 roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
139312024-11-25T19:44:22.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 5d87e951-c4fa-422f-9724-f80d1a2d5b81 resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
139322024-11-25T19:44:22.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = 5d87e951-c4fa-422f-9724-f80d1a2d5b81 response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?sort_by=id_ascending
139332024-11-25T19:44:22.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = a8cc25a7-3a01-481f-9140-24605a07b0cd roles = RoleSet { roles: {} } uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
139342024-11-25T19:44:22.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = a8cc25a7-3a01-481f-9140-24605a07b0cd resource = Database result = Ok(()) uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
139352024-11-25T19:44:22.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2782 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50192 req_id = a8cc25a7-3a01-481f-9140-24605a07b0cd response_code = 200 uri = /metrics/collectors/4f833d1f-8a98-4545-91ff-69d713fdd1f0/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWU0Njc1Yy03M2E1LTQ2YjUtOWUwZi05ZDA1Y2JiYTU2NzAifX0%3D
139362024-11-25T19:44:26.206ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
139372024-11-25T19:44:26.206ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139382024-11-25T19:44:26.206ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
139392024-11-25T19:44:26.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139402024-11-25T19:44:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139412024-11-25T19:44:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139422024-11-25T19:44:26.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139432024-11-25T19:44:26.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
139442024-11-25T19:44:26.211ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139452024-11-25T19:44:26.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139462024-11-25T19:44:26.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139472024-11-25T19:44:26.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139482024-11-25T19:44:26.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139492024-11-25T19:44:26.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139502024-11-25T19:44:26.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139512024-11-25T19:44:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
139522024-11-25T19:44:26.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139532024-11-25T19:44:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139542024-11-25T19:44:26.261ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
139552024-11-25T19:44:26.261ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.265615ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
139562024-11-25T19:44:26.263ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.029349ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
139572024-11-25T19:44:27.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1232 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 3fc156cc-af8f-4979-8595-0f0b522bdd2c response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb
139582024-11-25T19:44:36.207ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
139592024-11-25T19:44:36.207ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139602024-11-25T19:44:36.207ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
139612024-11-25T19:44:36.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139622024-11-25T19:44:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139632024-11-25T19:44:36.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139642024-11-25T19:44:36.209ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139652024-11-25T19:44:36.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139662024-11-25T19:44:36.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139672024-11-25T19:44:36.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
139682024-11-25T19:44:36.212ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139692024-11-25T19:44:36.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139702024-11-25T19:44:36.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139712024-11-25T19:44:36.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139722024-11-25T19:44:36.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139732024-11-25T19:44:36.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c0042f8f-3059-4f90-9d41-8b34f2747978, lookup_type: ById(c0042f8f-3059-4f90-9d41-8b34f2747978) } result = Ok(())
139742024-11-25T19:44:36.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139752024-11-25T19:44:36.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139762024-11-25T19:44:36.230ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 original_time_created = 2024-11-25 19:31:09.518680 UTC target_id = c0042f8f-3059-4f90-9d41-8b34f2747978 time_created = 2024-11-25 19:31:09.518680 UTC
139772024-11-25T19:44:36.230ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.930819ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c0042f8f-3059-4f90-9d41-8b34f2747978","time_created":"2024-11-25T19:31:09.518680Z"}
139782024-11-25T19:44:36.238ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.771403ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
139792024-11-25T19:44:36.492ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43273
139802024-11-25T19:44:36.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43273 req_id = 57245ad5-cc69-4062-86d3-2ccc57030f1c roles = RoleSet { roles: {} } uri = /metrics/producers
139812024-11-25T19:44:36.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43273 req_id = 57245ad5-cc69-4062-86d3-2ccc57030f1c resource = Database result = Ok(()) uri = /metrics/producers
139822024-11-25T19:44:36.528ZINFOnexus: assigned collector to new producer collector_id = 4f833d1f-8a98-4545-91ff-69d713fdd1f0 file = nexus/src/app/oximeter.rs:76 producer_id = e1e4675c-73a5-46b5-9e0f-9d05cbba5670
139832024-11-25T19:44:36.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35977 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43273 req_id = 57245ad5-cc69-4062-86d3-2ccc57030f1c response_code = 201 uri = /metrics/producers
139842024-11-25T19:44:37.294ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1170 local_addr = [fd00:1122:3344:101::b]:49979 method = GET remote_addr = [fd00:1122:3344:101::d]:44910 req_id = 78c4038c-5e34-4d69-8842-5c8e51bbb94d response_code = 200 uri = /1d808376-6b5a-46f0-b373-d7ba578556eb