Max level shown:
1 [ Aug 16 07:16:36 Enabled. ]
2 [ Aug 16 07:16:36 Rereading configuration. ]
3 [ Aug 16 07:16:38 Rereading configuration. ]
4 [ Aug 16 07:16:50 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Aug 16 07:16:50 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-08-16T07:16:50.375ZDEBGnexus: registered DTrace probes
82024-08-16T07:16:50.378ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:86
92024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
332024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
342024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
352024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
362024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
372024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
382024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
392024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
402024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
412024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
422024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
432024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
442024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
452024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
462024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
472024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
482024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
492024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
502024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
512024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
522024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
532024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
542024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
552024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
562024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
572024-08-16T07:16:50.386ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
582024-08-16T07:16:50.387ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
592024-08-16T07:16:50.387ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
602024-08-16T07:16:50.404ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:217
612024-08-16T07:16:50.407ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
622024-08-16T07:16:50.412ZINFOnexus (ServerContext): Accessing DB url from DNS file = nexus/src/context.rs:246
632024-08-16T07:16:50.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _cockroach._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_cockroach._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("09fcc4c3-1a1f-42bb-87f6-6db77b0720a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("19b9c556-e904-4b05-b8c9-0d4746115121.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("3e8baf1b-b50c-4219-84d8-b24c3d6dd215.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("92bc90c7-307e-4496-b47b-c75e1073f89d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_cockroach._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 32221, target: Name("ce2c8029-d512-4384-b2d0-0e4e7b91a8e6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ce2c8029-d512-4384-b2d0-0e4e7b91a8e6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::3))) }], valid_until: Instant { tv_sec: 1073, tv_nsec: 814065631 } })
642024-08-16T07:16:50.441ZINFOnexus (ServerContext): DB addresses: [fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::3]:32221 file = nexus/src/context.rs:276
652024-08-16T07:16:50.443ZINFOnexus (db::Pool): database connection pool database_url = postgresql://root@[fd00:1122:3344:101::6]:32221,[fd00:1122:3344:101::7]:32221,[fd00:1122:3344:101::5]:32221,[fd00:1122:3344:101::4]:32221,[fd00:1122:3344:101::3]:32221/omicron?sslmode=disable file = nexus/db-queries/src/db/pool.rs:69
662024-08-16T07:16:50.460ZINFOnexus: Database schema version is up to date desired_version = 87.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 87.0.0
672024-08-16T07:16:50.463ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1073, tv_nsec: 838793012 } })
682024-08-16T07:16:50.463ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
692024-08-16T07:16:50.463ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
702024-08-16T07:16:50.516ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
712024-08-16T07:16:50.516ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
722024-08-16T07:16:50.522ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2e965622-0841-4675-9b2c-9e9b0baaac6e", "content-length": "26", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
732024-08-16T07:16:50.522ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
742024-08-16T07:16:50.522ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
752024-08-16T07:16:50.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1073, tv_nsec: 932707261 } })
762024-08-16T07:16:50.558ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
772024-08-16T07:16:50.594ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
782024-08-16T07:16:50.594ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
792024-08-16T07:16:50.595ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "99566136-f265-452f-9605-4a54998059ed", "content-length": "26", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
802024-08-16T07:16:50.595ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
812024-08-16T07:16:50.595ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
822024-08-16T07:16:50.672ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
832024-08-16T07:16:50.684ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
842024-08-16T07:16:50.685ZDEBGnexus (DataLoader): attempting to create built-in users
852024-08-16T07:16:50.685ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
862024-08-16T07:16:50.685ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
872024-08-16T07:16:50.702ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
882024-08-16T07:16:50.702ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
892024-08-16T07:16:50.703ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
902024-08-16T07:16:50.703ZDEBGnexus (DataLoader): attempting to create built-in roles
912024-08-16T07:16:50.703ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
922024-08-16T07:16:50.703ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
932024-08-16T07:16:50.709ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
942024-08-16T07:16:50.709ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
952024-08-16T07:16:50.709ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
962024-08-16T07:16:50.709ZDEBGnexus (DataLoader): attempting to create built-in role assignments
972024-08-16T07:16:50.709ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
982024-08-16T07:16:50.709ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
992024-08-16T07:16:50.715ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /artifacts/{kind}/{name}/{version}
1002024-08-16T07:16:50.715ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks
1012024-08-16T07:16:50.715ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate
1022024-08-16T07:16:50.715ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name}
1032024-08-16T07:16:50.715ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request
1042024-08-16T07:16:50.715ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped
1052024-08-16T07:16:50.715ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress
1062024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish
1072024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start
1082024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga
1092024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete
1102024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all
1112024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id}
1122024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id}
1132024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import
1142024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate
1152024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target
1162024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target
1172024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled
1182024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent
1192024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id}
1202024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /instances/{instance_id}
1212024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate
1222024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors
1232024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers
1242024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers
1252024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen}
1262024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge
1272024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled}
1282024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete
1292024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas
1302024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id}
1312024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id}
1322024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}
1332024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update
1342024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add
1352024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge
1362024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized
1372024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id}
1382024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent
1392024-08-16T07:16:50.716ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::b]:12221
1402024-08-16T07:16:50.716ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1412024-08-16T07:16:50.720ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1422024-08-16T07:16:50.720ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1432024-08-16T07:16:50.724ZWARNnexus: Cannot look up rack: Object (of type ById(e1b0d583-7b20-4a4b-97f9-9f83300aeb7a)) not found: rack file = nexus/src/app/rack.rs:732
1442024-08-16T07:16:50.743ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1452024-08-16T07:16:50.743ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1462024-08-16T07:16:50.744ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1472024-08-16T07:16:50.744ZDEBGnexus (DataLoader): attempting to create built-in silos
1482024-08-16T07:16:50.744ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1492024-08-16T07:16:50.744ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1502024-08-16T07:16:50.795ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1512024-08-16T07:16:50.795ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1522024-08-16T07:16:50.795ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1532024-08-16T07:16:50.798ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542024-08-16T07:16:50.798ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552024-08-16T07:16:50.798ZDEBGnexus (DataLoader): attempting to create built-in projects
1562024-08-16T07:16:50.798ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1572024-08-16T07:16:50.799ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1582024-08-16T07:16:50.803ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1592024-08-16T07:16:50.804ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1602024-08-16T07:16:50.840ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1612024-08-16T07:16:50.840ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1622024-08-16T07:16:50.868ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1632024-08-16T07:16:50.871ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1642024-08-16T07:16:50.871ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1652024-08-16T07:16:50.871ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1662024-08-16T07:16:50.873ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1672024-08-16T07:16:50.873ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1682024-08-16T07:16:50.874ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692024-08-16T07:16:50.876ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1702024-08-16T07:16:50.876ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712024-08-16T07:16:50.876ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722024-08-16T07:16:50.901ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1732024-08-16T07:16:50.902ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-08-16T07:16:50.902ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1752024-08-16T07:16:50.902ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1762024-08-16T07:16:50.902ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1772024-08-16T07:16:50.903ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1782024-08-16T07:16:50.904ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1792024-08-16T07:16:50.904ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1802024-08-16T07:16:50.906ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1812024-08-16T07:16:50.906ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1822024-08-16T07:16:50.928ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1832024-08-16T07:16:50.928ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1842024-08-16T07:16:50.931ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1852024-08-16T07:16:50.931ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1862024-08-16T07:16:50.933ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1872024-08-16T07:16:50.935ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1882024-08-16T07:16:50.935ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1892024-08-16T07:16:50.936ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1902024-08-16T07:16:50.937ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912024-08-16T07:16:50.937ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1922024-08-16T07:16:50.938ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1932024-08-16T07:16:50.938ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1942024-08-16T07:16:50.939ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952024-08-16T07:16:50.943ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1962024-08-16T07:16:50.943ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972024-08-16T07:16:50.943ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982024-08-16T07:16:50.953ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1992024-08-16T07:16:50.953ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2002024-08-16T07:16:50.959ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2012024-08-16T07:16:50.959ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2022024-08-16T07:16:50.971ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2032024-08-16T07:16:50.971ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2042024-08-16T07:16:50.976ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2052024-08-16T07:16:50.976ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2062024-08-16T07:16:50.977ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072024-08-16T07:16:50.977ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082024-08-16T07:16:50.978ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-08-16T07:16:50.979ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102024-08-16T07:16:50.980ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112024-08-16T07:16:50.981ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122024-08-16T07:16:50.982ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132024-08-16T07:16:50.987ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2142024-08-16T07:16:50.987ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2152024-08-16T07:16:50.987ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2162024-08-16T07:16:50.988ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172024-08-16T07:16:50.988ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2182024-08-16T07:16:50.992ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2192024-08-16T07:16:50.992ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2202024-08-16T07:16:50.994ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2212024-08-16T07:16:50.997ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2222024-08-16T07:16:50.997ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2232024-08-16T07:16:50.997ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2242024-08-16T07:16:51.059ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2252024-08-16T07:16:51.059ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2262024-08-16T07:16:51.061ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2272024-08-16T07:16:51.061ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2282024-08-16T07:16:51.071ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292024-08-16T07:16:51.071ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2302024-08-16T07:16:51.072ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2312024-08-16T07:16:51.075ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2322024-08-16T07:16:51.075ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2332024-08-16T07:16:51.076ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2342024-08-16T07:16:51.117ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2352024-08-16T07:16:51.118ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-08-16T07:16:51.118ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372024-08-16T07:16:51.119ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-08-16T07:16:51.119ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392024-08-16T07:16:51.121ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-08-16T07:16:51.121ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412024-08-16T07:16:51.122ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-08-16T07:16:51.122ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432024-08-16T07:16:51.123ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442024-08-16T07:16:51.123ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2452024-08-16T07:16:51.124ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462024-08-16T07:16:51.124ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2472024-08-16T07:16:51.125ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482024-08-16T07:16:51.128ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2492024-08-16T07:16:51.128ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502024-08-16T07:16:51.128ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512024-08-16T07:16:51.129ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522024-08-16T07:16:51.129ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532024-08-16T07:16:51.130ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542024-08-16T07:16:51.130ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2552024-08-16T07:16:51.131ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562024-08-16T07:16:51.134ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2572024-08-16T07:16:51.134ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2582024-08-16T07:16:51.134ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2592024-08-16T07:16:51.141ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2602024-08-16T07:16:51.141ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2612024-08-16T07:16:51.146ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2622024-08-16T07:16:51.146ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2632024-08-16T07:16:51.147ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2642024-08-16T07:16:51.147ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2652024-08-16T07:16:51.148ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2662024-08-16T07:16:51.150ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2672024-08-16T07:16:51.150ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2682024-08-16T07:16:51.151ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2692024-08-16T07:16:51.207ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:252
2702024-08-16T07:16:51.207ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2712024-08-16T07:16:51.207ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2722024-08-16T07:16:51.207ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2732024-08-16T07:16:51.224ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2742024-08-16T07:16:51.224ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2752024-08-16T07:16:51.225ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2762024-08-16T07:16:51.225ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2772024-08-16T07:16:51.226ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2782024-08-16T07:16:51.226ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2792024-08-16T07:16:51.227ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2802024-08-16T07:16:51.227ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2812024-08-16T07:16:51.228ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2822024-08-16T07:16:51.228ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2832024-08-16T07:16:51.229ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2842024-08-16T07:16:51.232ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2852024-08-16T07:16:51.232ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2862024-08-16T07:16:51.232ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2872024-08-16T07:16:51.234ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2882024-08-16T07:16:51.234ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2892024-08-16T07:16:51.235ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2902024-08-16T07:16:51.235ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2912024-08-16T07:16:51.236ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2922024-08-16T07:16:51.236ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2932024-08-16T07:16:51.237ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2942024-08-16T07:16:51.237ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2952024-08-16T07:16:51.238ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2962024-08-16T07:16:51.238ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2972024-08-16T07:16:51.239ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2982024-08-16T07:16:51.239ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2992024-08-16T07:16:51.240ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3002024-08-16T07:16:51.243ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3012024-08-16T07:16:51.243ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3022024-08-16T07:16:51.243ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3032024-08-16T07:16:51.245ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3042024-08-16T07:16:51.245ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3052024-08-16T07:16:51.246ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3062024-08-16T07:16:51.246ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3072024-08-16T07:16:51.247ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3082024-08-16T07:16:51.247ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3092024-08-16T07:16:51.248ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3102024-08-16T07:16:51.248ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3112024-08-16T07:16:51.249ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3122024-08-16T07:16:51.249ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3132024-08-16T07:16:51.250ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3142024-08-16T07:16:51.250ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3152024-08-16T07:16:51.251ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3162024-08-16T07:16:51.254ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ById(001de000-c470-4000-8000-000000000002) } result = Ok(())
3172024-08-16T07:16:51.254ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3182024-08-16T07:16:51.254ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192024-08-16T07:16:51.255ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3202024-08-16T07:16:51.255ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3212024-08-16T07:16:51.256ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3222024-08-16T07:16:51.256ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3232024-08-16T07:16:51.257ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3242024-08-16T07:16:51.257ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3252024-08-16T07:16:51.258ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3262024-08-16T07:16:51.258ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3272024-08-16T07:16:51.259ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3282024-08-16T07:16:51.259ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292024-08-16T07:16:51.260ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3302024-08-16T07:16:51.260ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3312024-08-16T07:16:51.261ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3322024-08-16T07:16:51.264ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
3332024-08-16T07:16:51.264ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:316
3342024-08-16T07:16:51.264ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:194
3352024-08-16T07:16:51.264ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3362024-08-16T07:16:51.265ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3372024-08-16T07:16:51.265ZDEBGnexus (DataLoader): attempting to create silo users
3382024-08-16T07:16:51.265ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392024-08-16T07:16:51.265ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3402024-08-16T07:16:51.266ZINFOnexus (DataLoader): created 0 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3412024-08-16T07:16:51.266ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3422024-08-16T07:16:51.266ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432024-08-16T07:16:51.266ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3442024-08-16T07:16:51.267ZINFOnexus (DataLoader): created 0 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3452024-08-16T07:16:51.267ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3462024-08-16T07:16:51.267ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3472024-08-16T07:16:51.268ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3482024-08-16T07:16:51.268ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3492024-08-16T07:16:51.272ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3502024-08-16T07:16:51.272ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3512024-08-16T07:16:51.273ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3522024-08-16T07:16:51.274ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3532024-08-16T07:16:51.274ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3542024-08-16T07:16:51.274ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3552024-08-16T07:16:51.278ZINFOnexus: populate complete file = nexus/src/app/mod.rs:513
3562024-08-16T07:16:51.278ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:522
3572024-08-16T07:16:51.283ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
3582024-08-16T07:16:51.283ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
3592024-08-16T07:16:51.283ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
3602024-08-16T07:16:51.283ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
3612024-08-16T07:16:51.283ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
3622024-08-16T07:16:51.283ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
3632024-08-16T07:16:51.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3642024-08-16T07:16:51.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
3652024-08-16T07:16:51.283ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
3662024-08-16T07:16:51.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3672024-08-16T07:16:51.283ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3682024-08-16T07:16:51.283ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
3692024-08-16T07:16:51.284ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
3702024-08-16T07:16:51.284ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
3712024-08-16T07:16:51.284ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
3722024-08-16T07:16:51.284ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
3732024-08-16T07:16:51.284ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 103.562\u{b5}s iteration = 1 status = {"error":"no blueprint"}
3742024-08-16T07:16:51.284ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3752024-08-16T07:16:51.285ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
3762024-08-16T07:16:51.288ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
3772024-08-16T07:16:51.288ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.615199ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
3782024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
3792024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3802024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
3812024-08-16T07:16:51.289ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
3822024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
3832024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
3842024-08-16T07:16:51.289ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3852024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
3862024-08-16T07:16:51.289ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3872024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 5.502787ms iteration = 1 status = {"error":"no config nor servers"}
3882024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
3892024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 5.509087ms iteration = 1 status = {"error":"no config nor servers"}
3902024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
3912024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
3922024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
3932024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
3942024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
3952024-08-16T07:16:51.289ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
3962024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
3972024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
3982024-08-16T07:16:51.289ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:06:51.289723866 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3992024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4002024-08-16T07:16:51.289ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:60 reason = no blueprint
4012024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4022024-08-16T07:16:51.289ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 5.760143ms iteration = 1 status = {"error":"no blueprint"}
4032024-08-16T07:16:51.290ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4042024-08-16T07:16:51.290ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4052024-08-16T07:16:51.290ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4062024-08-16T07:16:51.290ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4072024-08-16T07:16:51.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4082024-08-16T07:16:51.290ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4092024-08-16T07:16:51.290ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4102024-08-16T07:16:51.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4112024-08-16T07:16:51.290ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4122024-08-16T07:16:51.290ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4132024-08-16T07:16:51.291ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4142024-08-16T07:16:51.291ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
4152024-08-16T07:16:51.291ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4162024-08-16T07:16:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4172024-08-16T07:16:51.291ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4182024-08-16T07:16:51.291ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4192024-08-16T07:16:51.291ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4202024-08-16T07:16:51.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4212024-08-16T07:16:51.291ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4222024-08-16T07:16:51.291ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4232024-08-16T07:16:51.291ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4242024-08-16T07:16:51.291ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4252024-08-16T07:16:51.291ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4262024-08-16T07:16:51.291ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
4272024-08-16T07:16:51.291ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4282024-08-16T07:16:51.291ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4292024-08-16T07:16:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4302024-08-16T07:16:51.293ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4312024-08-16T07:16:51.293ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4322024-08-16T07:16:51.293ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
4332024-08-16T07:16:51.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4342024-08-16T07:16:51.293ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
4352024-08-16T07:16:51.293ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4362024-08-16T07:16:51.293ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4372024-08-16T07:16:51.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4382024-08-16T07:16:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4392024-08-16T07:16:51.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4402024-08-16T07:16:51.295ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 669922967 } })
4412024-08-16T07:16:51.295ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 669925857 } })
4422024-08-16T07:16:51.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4432024-08-16T07:16:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4442024-08-16T07:16:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4452024-08-16T07:16:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4462024-08-16T07:16:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4472024-08-16T07:16:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4482024-08-16T07:16:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4492024-08-16T07:16:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4502024-08-16T07:16:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4512024-08-16T07:16:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4522024-08-16T07:16:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4532024-08-16T07:16:51.299ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4542024-08-16T07:16:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4552024-08-16T07:16:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4562024-08-16T07:16:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4572024-08-16T07:16:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4582024-08-16T07:16:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4592024-08-16T07:16:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4602024-08-16T07:16:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4612024-08-16T07:16:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4622024-08-16T07:16:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4632024-08-16T07:16:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4642024-08-16T07:16:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4652024-08-16T07:16:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
4662024-08-16T07:16:51.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4672024-08-16T07:16:51.300ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4682024-08-16T07:16:51.300ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 17.308669ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4692024-08-16T07:16:51.300ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4702024-08-16T07:16:51.300ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4712024-08-16T07:16:51.300ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 8.56\u{b5}s iteration = 2 status = {"error":"no config"}
4722024-08-16T07:16:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4732024-08-16T07:16:51.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4742024-08-16T07:16:51.301ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4752024-08-16T07:16:51.301ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 17.916914ms iteration = 1 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
4762024-08-16T07:16:51.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4772024-08-16T07:16:51.301ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4782024-08-16T07:16:51.301ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 15.35\u{b5}s iteration = 2 status = {"error":"no config"}
4792024-08-16T07:16:51.302ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4802024-08-16T07:16:51.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4812024-08-16T07:16:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4822024-08-16T07:16:51.305ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4832024-08-16T07:16:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4842024-08-16T07:16:51.310ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4852024-08-16T07:16:51.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4862024-08-16T07:16:51.311ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4872024-08-16T07:16:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4882024-08-16T07:16:51.312ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
4892024-08-16T07:16:51.312ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.2093ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
4902024-08-16T07:16:51.314ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4912024-08-16T07:16:51.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4922024-08-16T07:16:51.317ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4932024-08-16T07:16:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4942024-08-16T07:16:51.319ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4952024-08-16T07:16:51.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4962024-08-16T07:16:51.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4972024-08-16T07:16:51.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4982024-08-16T07:16:51.327ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4992024-08-16T07:16:51.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5002024-08-16T07:16:51.329ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5012024-08-16T07:16:51.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5022024-08-16T07:16:51.334ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5032024-08-16T07:16:51.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5042024-08-16T07:16:51.337ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5052024-08-16T07:16:51.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5062024-08-16T07:16:51.338ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5072024-08-16T07:16:51.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5082024-08-16T07:16:51.340ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5092024-08-16T07:16:51.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5102024-08-16T07:16:51.341ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5112024-08-16T07:16:51.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5122024-08-16T07:16:51.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5132024-08-16T07:16:51.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5142024-08-16T07:16:51.343ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5152024-08-16T07:16:51.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5162024-08-16T07:16:51.344ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5172024-08-16T07:16:51.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5182024-08-16T07:16:51.345ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5192024-08-16T07:16:51.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5202024-08-16T07:16:51.348ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5212024-08-16T07:16:51.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5222024-08-16T07:16:51.349ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5232024-08-16T07:16:51.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5242024-08-16T07:16:51.350ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5252024-08-16T07:16:51.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5262024-08-16T07:16:51.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5272024-08-16T07:16:51.351ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5282024-08-16T07:16:51.352ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5292024-08-16T07:16:51.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5302024-08-16T07:16:51.352ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
5312024-08-16T07:16:51.352ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
5322024-08-16T07:16:51.352ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.652284ms iteration = 1 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
5332024-08-16T07:16:51.353ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5342024-08-16T07:16:51.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5352024-08-16T07:16:51.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5362024-08-16T07:16:51.353ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5372024-08-16T07:16:51.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5382024-08-16T07:16:51.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5392024-08-16T07:16:51.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5402024-08-16T07:16:51.354ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5412024-08-16T07:16:51.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5422024-08-16T07:16:51.354ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5432024-08-16T07:16:51.355ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:06:51.289723866 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5442024-08-16T07:16:51.355ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 71.825869ms iteration = 1 status = {"expiration":"2024-08-16T07:06:51.289723866Z","pruned":[]}
5452024-08-16T07:16:51.355ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5462024-08-16T07:16:51.355ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 730776542 } })
5472024-08-16T07:16:51.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5482024-08-16T07:16:51.356ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
5492024-08-16T07:16:51.356ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5502024-08-16T07:16:51.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5512024-08-16T07:16:51.356ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
5522024-08-16T07:16:51.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5532024-08-16T07:16:51.356ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5542024-08-16T07:16:51.356ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5552024-08-16T07:16:51.356ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 73.361514ms iteration = 1 status = {}
5562024-08-16T07:16:51.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5572024-08-16T07:16:51.356ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5582024-08-16T07:16:51.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5592024-08-16T07:16:51.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5602024-08-16T07:16:51.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5612024-08-16T07:16:51.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5622024-08-16T07:16:51.359ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5632024-08-16T07:16:51.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5642024-08-16T07:16:51.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5652024-08-16T07:16:51.364ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5662024-08-16T07:16:51.364ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5672024-08-16T07:16:51.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5682024-08-16T07:16:51.364ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 73.087299ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5692024-08-16T07:16:51.365ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5702024-08-16T07:16:51.365ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5712024-08-16T07:16:51.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5722024-08-16T07:16:51.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5732024-08-16T07:16:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5742024-08-16T07:16:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5752024-08-16T07:16:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5762024-08-16T07:16:51.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5772024-08-16T07:16:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5782024-08-16T07:16:51.394ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
5792024-08-16T07:16:51.394ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5802024-08-16T07:16:51.394ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3961a0b7-8e6d-4b3e-9812-98f83e8fcdc7", "content-length": "26", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
5812024-08-16T07:16:51.402ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5822024-08-16T07:16:51.403ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5832024-08-16T07:16:51.406ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5842024-08-16T07:16:51.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5852024-08-16T07:16:51.426ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
5862024-08-16T07:16:51.426ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 142.818249ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
5872024-08-16T07:16:51.427ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
5882024-08-16T07:16:51.427ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
5892024-08-16T07:16:51.427ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.204546ms iteration = 1 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
5902024-08-16T07:16:51.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5912024-08-16T07:16:51.427ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5922024-08-16T07:16:51.428ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
5932024-08-16T07:16:51.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 143.290079ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5942024-08-16T07:16:51.429ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5952024-08-16T07:16:51.429ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 145.596002ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
5962024-08-16T07:16:51.429ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5972024-08-16T07:16:51.430ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
5982024-08-16T07:16:51.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 138.650582ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
5992024-08-16T07:16:51.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6002024-08-16T07:16:51.431ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6012024-08-16T07:16:51.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6022024-08-16T07:16:51.432ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
6032024-08-16T07:16:51.433ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6042024-08-16T07:16:51.433ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
6052024-08-16T07:16:51.433ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 149.013291ms iteration = 1 status = {"error":"rack not yet initialized: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a"}
6062024-08-16T07:16:51.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6072024-08-16T07:16:51.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
6082024-08-16T07:16:51.433ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6092024-08-16T07:16:51.433ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 808885226 } })
6102024-08-16T07:16:51.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6112024-08-16T07:16:51.433ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
6122024-08-16T07:16:51.433ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 150.383893ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
6132024-08-16T07:16:51.434ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6142024-08-16T07:16:51.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6152024-08-16T07:16:51.434ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6162024-08-16T07:16:51.434ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6172024-08-16T07:16:51.434ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6182024-08-16T07:16:51.434ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6192024-08-16T07:16:51.434ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 151.5607ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6202024-08-16T07:16:51.435ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
6212024-08-16T07:16:51.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6222024-08-16T07:16:51.435ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(183e9c68-5ee3-40fd-a109-c2a10df0c73a, 0)]
6232024-08-16T07:16:51.436ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6242024-08-16T07:16:51.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6252024-08-16T07:16:51.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6262024-08-16T07:16:51.437ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 813093543 } })
6272024-08-16T07:16:51.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6282024-08-16T07:16:51.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6292024-08-16T07:16:51.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6302024-08-16T07:16:51.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6312024-08-16T07:16:51.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6322024-08-16T07:16:51.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
6332024-08-16T07:16:51.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6342024-08-16T07:16:51.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6352024-08-16T07:16:51.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6362024-08-16T07:16:51.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6372024-08-16T07:16:51.445ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6382024-08-16T07:16:51.446ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "69d50392-f04b-4af1-8c13-773739abb2bb", "content-length": "1", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6392024-08-16T07:16:51.448ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6402024-08-16T07:16:51.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6412024-08-16T07:16:51.449ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6422024-08-16T07:16:51.449ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 165.765308ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6432024-08-16T07:16:51.450ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6442024-08-16T07:16:51.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6452024-08-16T07:16:51.450ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6462024-08-16T07:16:51.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6472024-08-16T07:16:51.454ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6482024-08-16T07:16:51.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6492024-08-16T07:16:51.455ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 171.959811ms iteration = 1 status = null
6502024-08-16T07:16:51.456ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6512024-08-16T07:16:51.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6522024-08-16T07:16:51.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6532024-08-16T07:16:51.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6542024-08-16T07:16:51.460ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6552024-08-16T07:16:51.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6562024-08-16T07:16:51.461ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6572024-08-16T07:16:51.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6582024-08-16T07:16:51.462ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6592024-08-16T07:16:51.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6602024-08-16T07:16:51.463ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6612024-08-16T07:16:51.465ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
6622024-08-16T07:16:51.465ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 182.043964ms iteration = 1 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
6632024-08-16T07:16:51.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
6642024-08-16T07:16:51.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6652024-08-16T07:16:51.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6662024-08-16T07:16:51.468ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6672024-08-16T07:16:51.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6682024-08-16T07:16:51.469ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6692024-08-16T07:16:51.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6702024-08-16T07:16:51.470ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6712024-08-16T07:16:51.473ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
6722024-08-16T07:16:51.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6732024-08-16T07:16:51.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6742024-08-16T07:16:51.490ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
6752024-08-16T07:16:51.490ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6762024-08-16T07:16:51.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6772024-08-16T07:16:51.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6782024-08-16T07:16:51.491ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 200.197143ms iteration = 1 status = {}
6792024-08-16T07:16:51.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6802024-08-16T07:16:51.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6812024-08-16T07:16:51.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
6822024-08-16T07:16:51.493ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6832024-08-16T07:16:51.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6842024-08-16T07:16:51.495ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
6852024-08-16T07:16:51.495ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
6862024-08-16T07:16:51.495ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
6872024-08-16T07:16:51.519ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
6882024-08-16T07:16:51.519ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6892024-08-16T07:16:51.520ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "60ae0510-8100-4762-a3ea-32842fb243d3", "content-length": "26", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} })
6902024-08-16T07:16:51.520ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6912024-08-16T07:16:51.521ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6922024-08-16T07:16:51.522ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6932024-08-16T07:16:51.522ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6942024-08-16T07:16:51.522ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6952024-08-16T07:16:51.523ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "39c36eaf-710e-45df-8fb2-5e22832dad49", "content-length": "476", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
6962024-08-16T07:16:51.523ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
6972024-08-16T07:16:51.523ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 240.182237ms iteration = 1 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
6982024-08-16T07:16:51.531ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6992024-08-16T07:16:51.531ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a54a05db-154c-485d-ab04-bdc0691a59d0", "content-length": "734", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7002024-08-16T07:16:51.535ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
7012024-08-16T07:16:51.535ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a4b033ba-ecc7-4172-8074-c663a252d583", "content-length": "86", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7022024-08-16T07:16:51.535ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
7032024-08-16T07:16:51.535ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6fe49392-682e-4fe0-b9fa-816bd5641e1d", "content-length": "86", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7042024-08-16T07:16:51.535ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
7052024-08-16T07:16:51.536ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a9ad4431-6db1-4189-9067-45a744b7cecc", "content-length": "80", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7062024-08-16T07:16:51.536ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
7072024-08-16T07:16:51.536ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "52aae42c-0d16-46de-8997-7490111b103d", "content-length": "80", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7082024-08-16T07:16:51.536ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
7092024-08-16T07:16:51.536ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0636be6b-ad30-4aeb-a165-45a2f61e096a", "content-length": "88", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7102024-08-16T07:16:51.536ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
7112024-08-16T07:16:51.537ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4472f953-402b-4d46-91e5-4305f54750d6", "content-length": "88", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7122024-08-16T07:16:51.537ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
7132024-08-16T07:16:51.537ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "80f29668-301e-45be-9f46-00217d354020", "content-length": "702", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7142024-08-16T07:16:51.537ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7152024-08-16T07:16:51.537ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b0179ac1-da4e-4bac-b499-f4df9f93978e", "content-length": "727", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7162024-08-16T07:16:51.538ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
7172024-08-16T07:16:51.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 247.126787ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7182024-08-16T07:16:51.539ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7192024-08-16T07:16:51.540ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6081713b-ce48-4b0a-985a-f0f564104dd6", "content-length": "729", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7202024-08-16T07:16:51.540ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7212024-08-16T07:16:51.540ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b0255b80-dec0-4ce7-81e7-42a3aa46bb89", "content-length": "728", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7222024-08-16T07:16:51.540ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
7232024-08-16T07:16:51.541ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "018778bd-93cb-4bd0-ba9f-b2915a326d1c", "content-length": "722", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7242024-08-16T07:16:51.541ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
7252024-08-16T07:16:51.541ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8299ffeb-f9c5-4db2-8b6d-a1057916aa65", "content-length": "84", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7262024-08-16T07:16:51.541ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
7272024-08-16T07:16:51.541ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ec59ce3f-56a1-4f72-b876-b3c45e979404", "content-length": "84", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7282024-08-16T07:16:51.541ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
7292024-08-16T07:16:51.541ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "534dec30-fe77-4475-a79f-ac449b29bf0c", "content-length": "82", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7302024-08-16T07:16:51.541ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
7312024-08-16T07:16:51.542ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e89887d3-9a73-4fea-9573-0c305df15a65", "content-length": "82", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7322024-08-16T07:16:51.542ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
7332024-08-16T07:16:51.542ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e6f87bbd-d7b9-4a5e-b050-af8618b3d528", "content-length": "91", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7342024-08-16T07:16:51.542ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7352024-08-16T07:16:51.543ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "25181860-dffa-4703-8903-cc497a79f08b", "content-length": "91", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7362024-08-16T07:16:51.543ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7372024-08-16T07:16:51.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6d9a5d0a-c5ba-492a-9017-442d65adfcf4", "content-length": "702", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7382024-08-16T07:16:51.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7392024-08-16T07:16:51.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "91596b05-b969-43de-871c-73c7e1858fd0", "content-length": "727", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7402024-08-16T07:16:51.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7412024-08-16T07:16:51.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "57f3242b-4c20-4ece-8d2f-86d1af935a52", "content-length": "729", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7422024-08-16T07:16:51.544ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7432024-08-16T07:16:51.544ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab22c385-4ef6-4f4f-a030-9ff4df903b48", "content-length": "728", "date": "Fri, 16 Aug 2024 07:16:51 GMT"} })
7442024-08-16T07:16:51.544ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7452024-08-16T07:16:51.545ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7462024-08-16T07:16:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7472024-08-16T07:16:51.545ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 259.887722ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7482024-08-16T07:16:51.558ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 274.9695ms iteration = 1 status = {}
7492024-08-16T07:16:51.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7502024-08-16T07:16:51.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7512024-08-16T07:16:51.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7522024-08-16T07:16:51.586ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
7532024-08-16T07:16:51.586ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
7542024-08-16T07:16:51.586ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
7552024-08-16T07:16:51.586ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 295.493574ms
7562024-08-16T07:16:51.586ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 295.504954ms iteration = 1 status = {}
7572024-08-16T07:16:51.586ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7582024-08-16T07:16:51.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7592024-08-16T07:16:51.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7602024-08-16T07:16:51.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7612024-08-16T07:16:51.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7622024-08-16T07:16:51.588ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7632024-08-16T07:16:51.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7642024-08-16T07:16:51.589ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7652024-08-16T07:16:51.590ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7662024-08-16T07:16:51.590ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7672024-08-16T07:16:51.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7682024-08-16T07:16:51.624ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7692024-08-16T07:16:51.626ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7702024-08-16T07:16:51.626ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7712024-08-16T07:16:51.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7722024-08-16T07:16:51.661ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 378.361278ms iteration = 1 status = {}
7732024-08-16T07:16:51.684ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7742024-08-16T07:16:51.684ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7752024-08-16T07:16:51.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7762024-08-16T07:16:51.685ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7772024-08-16T07:16:51.687ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7782024-08-16T07:16:51.689ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7792024-08-16T07:16:51.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7802024-08-16T07:16:51.771ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 553e2faf-30c0-4390-b228-b82c6e2a23da file = nexus/db-queries/src/db/datastore/inventory.rs:893
7812024-08-16T07:16:51.773ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 553e2faf-30c0-4390-b228-b82c6e2a23da time_started = 2024-08-16 07:16:51.520705 UTC
7822024-08-16T07:16:51.773ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 488.904721ms iteration = 1 status = {"collection_id":"553e2faf-30c0-4390-b228-b82c6e2a23da","time_done":"2024-08-16 07:16:51.684309 UTC","time_started":"2024-08-16 07:16:51.520705 UTC"}
7832024-08-16T07:16:51.773ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
7842024-08-16T07:16:51.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7852024-08-16T07:16:51.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7862024-08-16T07:16:51.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7872024-08-16T07:16:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7882024-08-16T07:16:51.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7892024-08-16T07:16:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7902024-08-16T07:16:51.779ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
7912024-08-16T07:16:51.779ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 6.003529ms iteration = 2 status = {"error":"rack not yet initialized: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a"}
7922024-08-16T07:16:51.887ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:59148
7932024-08-16T07:16:51.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
7942024-08-16T07:16:51.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
7952024-08-16T07:16:51.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
7962024-08-16T07:16:51.901ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
7972024-08-16T07:16:51.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
7982024-08-16T07:16:51.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
7992024-08-16T07:16:51.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8002024-08-16T07:16:51.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8012024-08-16T07:16:51.943ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 setting = cluster.preserve_downgrade_option uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete value = 22.1
8022024-08-16T07:16:51.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8032024-08-16T07:16:51.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8042024-08-16T07:16:51.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8052024-08-16T07:16:51.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8062024-08-16T07:16:51.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8072024-08-16T07:16:51.949ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Rack { parent: Fleet, key: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, lookup_type: ById(e1b0d583-7b20-4a4b-97f9-9f83300aeb7a) } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8082024-08-16T07:16:51.949ZDEBGnexus (dropshot_internal): updating rack subnet for rack e1b0d583-7b20-4a4b-97f9-9f83300aeb7a to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8092024-08-16T07:16:51.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8102024-08-16T07:16:51.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8112024-08-16T07:16:51.952ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:301 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8122024-08-16T07:16:51.982ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8132024-08-16T07:16:51.983ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/ports", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "03d666d3-dc3d-4938-87df-5a04658ca321", "content-length": "24", "date": "Fri, 16 Aug 2024 07:16:50 GMT"} }) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8142024-08-16T07:16:51.985ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:321 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8152024-08-16T07:16:51.985ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:331 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8162024-08-16T07:16:51.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8172024-08-16T07:16:51.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8182024-08-16T07:16:51.993ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:366 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8192024-08-16T07:16:51.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8202024-08-16T07:16:51.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8212024-08-16T07:16:52.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8222024-08-16T07:16:52.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8232024-08-16T07:16:52.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8242024-08-16T07:16:52.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8252024-08-16T07:16:52.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8262024-08-16T07:16:52.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8272024-08-16T07:16:52.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8282024-08-16T07:16:52.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8292024-08-16T07:16:52.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8302024-08-16T07:16:52.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8312024-08-16T07:16:52.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8322024-08-16T07:16:52.133ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8332024-08-16T07:16:52.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8342024-08-16T07:16:52.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8352024-08-16T07:16:52.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8362024-08-16T07:16:52.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8372024-08-16T07:16:52.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8382024-08-16T07:16:52.138ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = IpPool { parent: Fleet, key: 6ec726e9-a0f6-4f57-964c-011c5a7796de, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8392024-08-16T07:16:52.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8402024-08-16T07:16:52.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8412024-08-16T07:16:52.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8422024-08-16T07:16:52.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8432024-08-16T07:16:52.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8442024-08-16T07:16:52.141ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = IpPool { parent: Fleet, key: 6ec726e9-a0f6-4f57-964c-011c5a7796de, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8452024-08-16T07:16:52.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8462024-08-16T07:16:52.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8472024-08-16T07:16:52.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8482024-08-16T07:16:52.154ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = BlueprintConfig result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8492024-08-16T07:16:52.228ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = caf7b37b-a2ed-40ca-95aa-b423c866615d file = nexus/db-queries/src/db/datastore/deployment.rs:266 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8502024-08-16T07:16:52.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8512024-08-16T07:16:52.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8522024-08-16T07:16:52.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8532024-08-16T07:16:52.230ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = BlueprintConfig result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8542024-08-16T07:16:52.233ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8552024-08-16T07:16:52.233ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8562024-08-16T07:16:52.233ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8572024-08-16T07:16:52.234ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8582024-08-16T07:16:52.234ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8592024-08-16T07:16:52.234ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8602024-08-16T07:16:52.234ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8612024-08-16T07:16:52.234ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8622024-08-16T07:16:52.308ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8632024-08-16T07:16:52.324ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8642024-08-16T07:16:52.339ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8652024-08-16T07:16:52.355ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8662024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8672024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8682024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8692024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8702024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8712024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8722024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8732024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8742024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8752024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8762024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8772024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8782024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8792024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8802024-08-16T07:16:52.371ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8812024-08-16T07:16:52.386ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8822024-08-16T07:16:52.386ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8832024-08-16T07:16:52.386ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 8ba2638c-8d61-4834-b735-8e6bd80e971c, time_created: 2024-08-16T07:16:51.901158117Z, time_modified: 2024-08-16T07:16:51.901158117Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8842024-08-16T07:16:52.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8852024-08-16T07:16:52.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8862024-08-16T07:16:52.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8872024-08-16T07:16:52.389ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8882024-08-16T07:16:52.401ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8892024-08-16T07:16:52.404ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae" error_message_internal = not found: sled with id "03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae" file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:902 latency_us = 516704 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 8ff2cd91-5983-4f11-946b-caa00cd4e8d1 response_code = 404 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
8902024-08-16T07:16:52.726ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8912024-08-16T07:16:52.726ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8922024-08-16T07:16:52.727ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8932024-08-16T07:16:52.727ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8942024-08-16T07:16:52.728ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8952024-08-16T07:16:52.731ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, lookup_type: ById(e1b0d583-7b20-4a4b-97f9-9f83300aeb7a) } result = Ok(())
8962024-08-16T07:16:52.731ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, time_created: 2024-08-16T07:16:50.755850Z, time_modified: 2024-08-16T07:16:50.755850Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:726
8972024-08-16T07:16:54.732ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8982024-08-16T07:16:54.732ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8992024-08-16T07:16:54.733ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9002024-08-16T07:16:54.733ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9012024-08-16T07:16:54.734ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9022024-08-16T07:16:54.736ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, lookup_type: ById(e1b0d583-7b20-4a4b-97f9-9f83300aeb7a) } result = Ok(())
9032024-08-16T07:16:54.736ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, time_created: 2024-08-16T07:16:50.755850Z, time_modified: 2024-08-16T07:16:50.755850Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:726
9042024-08-16T07:16:55.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9052024-08-16T07:16:55.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9062024-08-16T07:16:55.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9072024-08-16T07:16:55.302ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9082024-08-16T07:16:55.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9092024-08-16T07:16:55.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9102024-08-16T07:16:55.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9112024-08-16T07:16:55.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9122024-08-16T07:16:55.313ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 setting = cluster.preserve_downgrade_option uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete value = 22.1
9132024-08-16T07:16:55.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9142024-08-16T07:16:55.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9152024-08-16T07:16:55.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9162024-08-16T07:16:55.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9172024-08-16T07:16:55.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9182024-08-16T07:16:55.318ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Rack { parent: Fleet, key: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, lookup_type: ById(e1b0d583-7b20-4a4b-97f9-9f83300aeb7a) } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9192024-08-16T07:16:55.318ZDEBGnexus (dropshot_internal): updating rack subnet for rack e1b0d583-7b20-4a4b-97f9-9f83300aeb7a to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9202024-08-16T07:16:55.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9212024-08-16T07:16:55.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9222024-08-16T07:16:55.321ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:301 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9232024-08-16T07:16:55.353ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9242024-08-16T07:16:55.353ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/ports", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "53b9f21b-1b7a-49f0-ba19-e39bce74626c", "content-length": "24", "date": "Fri, 16 Aug 2024 07:16:55 GMT"} }) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9252024-08-16T07:16:55.353ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:321 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9262024-08-16T07:16:55.353ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:331 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9272024-08-16T07:16:55.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9282024-08-16T07:16:55.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9292024-08-16T07:16:55.360ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:366 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9302024-08-16T07:16:55.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9312024-08-16T07:16:55.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9322024-08-16T07:16:55.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9332024-08-16T07:16:55.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9342024-08-16T07:16:55.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9352024-08-16T07:16:55.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9362024-08-16T07:16:55.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9372024-08-16T07:16:55.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9382024-08-16T07:16:55.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9392024-08-16T07:16:55.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9402024-08-16T07:16:55.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9412024-08-16T07:16:55.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9422024-08-16T07:16:55.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9432024-08-16T07:16:55.372ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9442024-08-16T07:16:55.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9452024-08-16T07:16:55.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9462024-08-16T07:16:55.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9472024-08-16T07:16:55.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9482024-08-16T07:16:55.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9492024-08-16T07:16:55.377ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = IpPool { parent: Fleet, key: 6ec726e9-a0f6-4f57-964c-011c5a7796de, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9502024-08-16T07:16:55.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9512024-08-16T07:16:55.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9522024-08-16T07:16:55.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9532024-08-16T07:16:55.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9542024-08-16T07:16:55.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9552024-08-16T07:16:55.380ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = IpPool { parent: Fleet, key: 6ec726e9-a0f6-4f57-964c-011c5a7796de, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9562024-08-16T07:16:55.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9572024-08-16T07:16:55.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9582024-08-16T07:16:55.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9592024-08-16T07:16:55.385ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = BlueprintConfig result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9602024-08-16T07:16:55.392ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = caf7b37b-a2ed-40ca-95aa-b423c866615d file = nexus/db-queries/src/db/datastore/deployment.rs:266 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9612024-08-16T07:16:55.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9622024-08-16T07:16:55.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9632024-08-16T07:16:55.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9642024-08-16T07:16:55.394ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = BlueprintConfig result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9652024-08-16T07:16:55.396ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9662024-08-16T07:16:55.396ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9672024-08-16T07:16:55.396ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9682024-08-16T07:16:55.396ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9692024-08-16T07:16:55.396ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9702024-08-16T07:16:55.396ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9712024-08-16T07:16:55.396ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9722024-08-16T07:16:55.396ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9732024-08-16T07:16:55.421ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9742024-08-16T07:16:55.436ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9752024-08-16T07:16:55.451ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9762024-08-16T07:16:55.466ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9772024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9782024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9792024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9802024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9812024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9822024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9832024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9842024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9852024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9862024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9872024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9882024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9892024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9902024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9912024-08-16T07:16:55.481ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9922024-08-16T07:16:55.496ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9932024-08-16T07:16:55.496ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9942024-08-16T07:16:55.496ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 8ba2638c-8d61-4834-b735-8e6bd80e971c, time_created: 2024-08-16T07:16:55.302306496Z, time_modified: 2024-08-16T07:16:55.302306496Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9952024-08-16T07:16:55.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9962024-08-16T07:16:55.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9972024-08-16T07:16:55.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9982024-08-16T07:16:55.499ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
9992024-08-16T07:16:55.502ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 78fdf8d3-657e-4f0f-9b87-832c7bc0c83b, time_created: 2024-08-16T07:16:55.302306966Z, time_modified: 2024-08-16T07:16:55.302306966Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2", variant: U2, sled_id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10002024-08-16T07:16:55.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10012024-08-16T07:16:55.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10022024-08-16T07:16:55.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10032024-08-16T07:16:55.504ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10042024-08-16T07:16:55.507ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: c05ef447-eae7-43ba-a286-05755fb3be0a, time_created: 2024-08-16T07:16:55.302307056Z, time_modified: 2024-08-16T07:16:55.302307056Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2", variant: U2, sled_id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10052024-08-16T07:16:55.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10062024-08-16T07:16:55.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10072024-08-16T07:16:55.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10082024-08-16T07:16:55.509ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10092024-08-16T07:16:55.512ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: bb50f8e3-1ddd-4414-b76d-8046862edd92, time_created: 2024-08-16T07:16:55.302307166Z, time_modified: 2024-08-16T07:16:55.302307166Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2", variant: U2, sled_id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10102024-08-16T07:16:55.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10112024-08-16T07:16:55.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10122024-08-16T07:16:55.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10132024-08-16T07:16:55.515ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10142024-08-16T07:16:55.517ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 20f14d43-5d62-45a4-bfd9-535799589dd8, time_created: 2024-08-16T07:16:55.302307246Z, time_modified: 2024-08-16T07:16:55.302307246Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2", variant: U2, sled_id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10152024-08-16T07:16:55.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10162024-08-16T07:16:55.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10172024-08-16T07:16:55.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10182024-08-16T07:16:55.520ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10192024-08-16T07:16:55.522ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: d621ca10-cec2-4ab3-aab5-55dd0259f4d5, time_created: 2024-08-16T07:16:55.302307316Z, time_modified: 2024-08-16T07:16:55.302307316Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2", variant: U2, sled_id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10202024-08-16T07:16:55.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10212024-08-16T07:16:55.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10222024-08-16T07:16:55.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10232024-08-16T07:16:55.525ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10242024-08-16T07:16:55.528ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 93f280e8-0186-4651-8dfc-32a3804bafe9, time_created: 2024-08-16T07:16:55.302307396Z, time_modified: 2024-08-16T07:16:55.302307396Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2", variant: U2, sled_id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10252024-08-16T07:16:55.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10262024-08-16T07:16:55.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10272024-08-16T07:16:55.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10282024-08-16T07:16:55.530ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10292024-08-16T07:16:55.533ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 469a267e-6926-40f5-bfb8-bf542eedb215, time_created: 2024-08-16T07:16:55.302307476Z, time_modified: 2024-08-16T07:16:55.302307476Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2", variant: U2, sled_id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10302024-08-16T07:16:55.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10312024-08-16T07:16:55.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10322024-08-16T07:16:55.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10332024-08-16T07:16:55.536ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10342024-08-16T07:16:55.538ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 3305725d-b5ea-4303-b241-97042197847c, time_created: 2024-08-16T07:16:55.302307556Z, time_modified: 2024-08-16T07:16:55.302307556Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2", variant: U2, sled_id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10352024-08-16T07:16:55.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10362024-08-16T07:16:55.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10372024-08-16T07:16:55.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10382024-08-16T07:16:55.541ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10392024-08-16T07:16:55.543ZINFOnexus (dropshot_internal): Inserted physical disks actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:823 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10402024-08-16T07:16:55.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10412024-08-16T07:16:55.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10422024-08-16T07:16:55.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10432024-08-16T07:16:55.545ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10442024-08-16T07:16:55.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10452024-08-16T07:16:55.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10462024-08-16T07:16:55.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10472024-08-16T07:16:55.552ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10482024-08-16T07:16:55.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10492024-08-16T07:16:55.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10502024-08-16T07:16:55.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10512024-08-16T07:16:55.556ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10522024-08-16T07:16:55.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10532024-08-16T07:16:55.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10542024-08-16T07:16:55.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10552024-08-16T07:16:55.561ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10562024-08-16T07:16:55.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10572024-08-16T07:16:55.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10582024-08-16T07:16:55.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10592024-08-16T07:16:55.565ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10602024-08-16T07:16:55.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10612024-08-16T07:16:55.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10622024-08-16T07:16:55.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10632024-08-16T07:16:55.570ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10642024-08-16T07:16:55.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10652024-08-16T07:16:55.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10662024-08-16T07:16:55.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10672024-08-16T07:16:55.575ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10682024-08-16T07:16:55.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10692024-08-16T07:16:55.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10702024-08-16T07:16:55.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10712024-08-16T07:16:55.579ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10722024-08-16T07:16:55.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10732024-08-16T07:16:55.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10742024-08-16T07:16:55.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10752024-08-16T07:16:55.590ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10762024-08-16T07:16:55.593ZINFOnexus (dropshot_internal): Inserted zpools actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:835 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10772024-08-16T07:16:55.667ZINFOnexus (dropshot_internal): Inserted datasets actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:865 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10782024-08-16T07:16:55.680ZINFOnexus (dropshot_internal): Populated DNS tables for internal DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:876 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10792024-08-16T07:16:55.682ZINFOnexus (dropshot_internal): Populated DNS tables for external DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:885 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10802024-08-16T07:16:55.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10812024-08-16T07:16:55.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10822024-08-16T07:16:55.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10832024-08-16T07:16:55.685ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10842024-08-16T07:16:55.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10852024-08-16T07:16:55.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10862024-08-16T07:16:55.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10872024-08-16T07:16:55.687ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10882024-08-16T07:16:55.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10892024-08-16T07:16:55.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10902024-08-16T07:16:55.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10912024-08-16T07:16:55.715ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = DnsConfig result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10922024-08-16T07:16:55.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10932024-08-16T07:16:55.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10942024-08-16T07:16:55.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10952024-08-16T07:16:55.719ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = DnsConfig result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10962024-08-16T07:16:55.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10972024-08-16T07:16:55.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10982024-08-16T07:16:55.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
10992024-08-16T07:16:55.723ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = DnsConfig result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11002024-08-16T07:16:55.727ZINFOnexus (dropshot_internal): Created recovery silo actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:451 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11012024-08-16T07:16:55.728ZINFOnexus (dropshot_internal): Created recovery user actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:467 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11022024-08-16T07:16:55.728ZINFOnexus (dropshot_internal): Created recovery user's password actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:481 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11032024-08-16T07:16:55.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11042024-08-16T07:16:55.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11052024-08-16T07:16:55.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11062024-08-16T07:16:55.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11072024-08-16T07:16:55.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11082024-08-16T07:16:55.731ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11092024-08-16T07:16:55.731ZDEBGnexus (dropshot_internal): Generated role assignment queries actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11102024-08-16T07:16:55.739ZINFOnexus (dropshot_internal): Granted Silo privileges actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11112024-08-16T07:16:55.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11122024-08-16T07:16:55.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11132024-08-16T07:16:55.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11142024-08-16T07:16:55.741ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11152024-08-16T07:16:55.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11162024-08-16T07:16:55.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11172024-08-16T07:16:55.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11182024-08-16T07:16:55.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11192024-08-16T07:16:55.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11202024-08-16T07:16:55.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11212024-08-16T07:16:55.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11222024-08-16T07:16:55.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11232024-08-16T07:16:55.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11242024-08-16T07:16:55.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11252024-08-16T07:16:55.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11262024-08-16T07:16:55.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11272024-08-16T07:16:55.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11282024-08-16T07:16:55.764ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11292024-08-16T07:16:55.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11302024-08-16T07:16:55.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11312024-08-16T07:16:55.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11322024-08-16T07:16:55.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11332024-08-16T07:16:55.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11342024-08-16T07:16:55.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11352024-08-16T07:16:55.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11362024-08-16T07:16:55.770ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11372024-08-16T07:16:55.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11382024-08-16T07:16:55.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11392024-08-16T07:16:55.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11402024-08-16T07:16:55.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11412024-08-16T07:16:55.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11422024-08-16T07:16:55.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11432024-08-16T07:16:55.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11442024-08-16T07:16:55.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11452024-08-16T07:16:55.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11462024-08-16T07:16:55.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11472024-08-16T07:16:55.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11482024-08-16T07:16:55.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11492024-08-16T07:16:55.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11502024-08-16T07:16:55.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11512024-08-16T07:16:55.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11522024-08-16T07:16:55.780ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11532024-08-16T07:16:55.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11542024-08-16T07:16:55.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11552024-08-16T07:16:55.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11562024-08-16T07:16:55.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11572024-08-16T07:16:55.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11582024-08-16T07:16:55.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11592024-08-16T07:16:55.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11602024-08-16T07:16:55.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11612024-08-16T07:16:55.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11622024-08-16T07:16:55.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11632024-08-16T07:16:55.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11642024-08-16T07:16:55.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11652024-08-16T07:16:55.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11662024-08-16T07:16:55.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11672024-08-16T07:16:55.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11682024-08-16T07:16:55.791ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11692024-08-16T07:16:55.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11702024-08-16T07:16:55.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11712024-08-16T07:16:55.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11722024-08-16T07:16:55.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11732024-08-16T07:16:55.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11742024-08-16T07:16:55.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11752024-08-16T07:16:55.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11762024-08-16T07:16:55.796ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11772024-08-16T07:16:55.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11782024-08-16T07:16:55.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11792024-08-16T07:16:55.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11802024-08-16T07:16:55.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11812024-08-16T07:16:55.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11822024-08-16T07:16:55.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11832024-08-16T07:16:55.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11842024-08-16T07:16:55.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11852024-08-16T07:16:55.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11862024-08-16T07:16:55.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11872024-08-16T07:16:55.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11882024-08-16T07:16:55.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11892024-08-16T07:16:55.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11902024-08-16T07:16:55.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11912024-08-16T07:16:55.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11922024-08-16T07:16:55.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11932024-08-16T07:16:55.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11942024-08-16T07:16:55.810ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11952024-08-16T07:16:55.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11962024-08-16T07:16:55.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11972024-08-16T07:16:55.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11982024-08-16T07:16:55.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
11992024-08-16T07:16:55.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12002024-08-16T07:16:55.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12012024-08-16T07:16:55.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12022024-08-16T07:16:55.816ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12032024-08-16T07:16:55.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12042024-08-16T07:16:55.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12052024-08-16T07:16:55.822ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 036a4ce6-ea03-4027-b4fc-46b08e5aab80, kind: Service { id: 0d900881-9285-4dbf-910f-5e4676c8f133 }, name: Name("nexus-0d900881-9285-4dbf-910f-5e4676c8f133"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d720059-2cc6-4a99-8f2a-da62f41fe70c, kind: Service { id: 09eed6fc-f2ea-4ebd-a66c-d8895818c00c }, name: Name("nexus-09eed6fc-f2ea-4ebd-a66c-d8895818c00c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: addeeb4f-a7d0-4d63-8259-b305b18b5ab1, kind: Service { id: 30e79e9e-c63b-4bdf-99e7-c71a02ecefc5 }, name: Name("nexus-30e79e9e-c63b-4bdf-99e7-c71a02ecefc5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0394c19d-c776-4986-aadf-3eb1689e7bef, kind: Service { id: dec19c15-1a2d-47ac-9b9e-9f424d3a3464 }, name: Name("external-dns-dec19c15-1a2d-47ac-9b9e-9f424d3a3464"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e9bad3ae-7417-4456-8d3e-34e4cbaa5de1, kind: Service { id: f9649eef-936b-4765-9810-da8662275db5 }, name: Name("external-dns-f9649eef-936b-4765-9810-da8662275db5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 132])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
12062024-08-16T07:16:55.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12072024-08-16T07:16:55.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12082024-08-16T07:16:55.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12092024-08-16T07:16:55.825ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Fleet result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12102024-08-16T07:16:55.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 roles = RoleSet { roles: {} } uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12112024-08-16T07:16:55.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 resource = Database result = Ok(()) uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12122024-08-16T07:16:55.826ZDEBGnexus: Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
12132024-08-16T07:16:55.827ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0394c19d-c776-4986-aadf-3eb1689e7bef, kind: Service { id: dec19c15-1a2d-47ac-9b9e-9f424d3a3464 }, name: Name("external-dns-dec19c15-1a2d-47ac-9b9e-9f424d3a3464"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e9bad3ae-7417-4456-8d3e-34e4cbaa5de1, kind: Service { id: f9649eef-936b-4765-9810-da8662275db5 }, name: Name("external-dns-f9649eef-936b-4765-9810-da8662275db5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 132])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 036a4ce6-ea03-4027-b4fc-46b08e5aab80, kind: Service { id: 0d900881-9285-4dbf-910f-5e4676c8f133 }, name: Name("nexus-0d900881-9285-4dbf-910f-5e4676c8f133"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d720059-2cc6-4a99-8f2a-da62f41fe70c, kind: Service { id: 09eed6fc-f2ea-4ebd-a66c-d8895818c00c }, name: Name("nexus-09eed6fc-f2ea-4ebd-a66c-d8895818c00c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: addeeb4f-a7d0-4d63-8259-b305b18b5ab1, kind: Service { id: 30e79e9e-c63b-4bdf-99e7-c71a02ecefc5 }, name: Name("nexus-30e79e9e-c63b-4bdf-99e7-c71a02ecefc5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
12142024-08-16T07:16:55.827ZDEBGnexus: resolved 2 rules for sleds
12152024-08-16T07:16:55.923ZDEBGnexus: resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, time_created: 2024-08-16T07:16:52.894284Z, time_modified: 2024-08-16T07:16:52.894284Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
12162024-08-16T07:16:55.923ZDEBGnexus: sending firewall rules to sled agents
12172024-08-16T07:16:55.923ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12182024-08-16T07:16:55.923ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12192024-08-16T07:16:55.925ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12202024-08-16T07:16:55.925ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12212024-08-16T07:16:55.926ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
12222024-08-16T07:16:55.927ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
12232024-08-16T07:16:55.959ZDEBGnexus: client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
12242024-08-16T07:16:55.963ZDEBGnexus: client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "20d0ce36-56ad-47ff-aed9-eefad386f708", "date": "Fri, 16 Aug 2024 07:16:55 GMT"} })
12252024-08-16T07:16:55.964ZINFOnexus: updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
12262024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
12272024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
12282024-08-16T07:16:55.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 666172 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59148 req_id = 7fb1fe60-115a-4858-bb77-66acaa1f3593 response_code = 204 uri = /racks/e1b0d583-7b20-4a4b-97f9-9f83300aeb7a/initialization-complete
12292024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
12302024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
12312024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12322024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
12332024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
12342024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12352024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
12362024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12372024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
12382024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12392024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12402024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12412024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12422024-08-16T07:16:55.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12432024-08-16T07:16:55.964ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 340233157 } })
12442024-08-16T07:16:55.964ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 340291288 } })
12452024-08-16T07:16:55.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12462024-08-16T07:16:55.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12472024-08-16T07:16:55.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12482024-08-16T07:16:55.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12492024-08-16T07:16:55.965ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12502024-08-16T07:16:55.966ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12512024-08-16T07:16:55.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12522024-08-16T07:16:55.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12532024-08-16T07:16:55.966ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
12542024-08-16T07:16:55.966ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.328833ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
12552024-08-16T07:16:55.967ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
12562024-08-16T07:16:55.967ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.395169ms iteration = 2 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
12572024-08-16T07:16:55.968ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12582024-08-16T07:16:55.968ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12592024-08-16T07:16:55.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12602024-08-16T07:16:55.969ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
12612024-08-16T07:16:55.969ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12622024-08-16T07:16:55.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12632024-08-16T07:16:55.969ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12642024-08-16T07:16:55.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12652024-08-16T07:16:55.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12662024-08-16T07:16:55.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12672024-08-16T07:16:55.970ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12682024-08-16T07:16:55.971ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(183e9c68-5ee3-40fd-a109-c2a10df0c73a, 0), (553e2faf-30c0-4390-b228-b82c6e2a23da, 0), (1ac544de-8fad-4d7d-9f56-e60ff67ed4b9, 0), (5910cf20-b41a-492d-b1af-4b28539e68f6, 0)] collection_id = 183e9c68-5ee3-40fd-a109-c2a10df0c73a
12692024-08-16T07:16:55.971ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12702024-08-16T07:16:55.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12712024-08-16T07:16:55.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
12722024-08-16T07:16:55.973ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12732024-08-16T07:16:55.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12742024-08-16T07:16:55.991ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 183e9c68-5ee3-40fd-a109-c2a10df0c73a file = nexus/db-queries/src/db/datastore/inventory.rs:1299 ncabooses = 12 ncollections = 1 nerrors = 0 nnics = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
12752024-08-16T07:16:55.991ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12762024-08-16T07:16:55.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12772024-08-16T07:16:55.994ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(553e2faf-30c0-4390-b228-b82c6e2a23da, 0), (1ac544de-8fad-4d7d-9f56-e60ff67ed4b9, 0), (5910cf20-b41a-492d-b1af-4b28539e68f6, 0)]
12782024-08-16T07:16:55.994ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1079, tv_nsec: 370313061 } })
12792024-08-16T07:16:55.995ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12802024-08-16T07:16:55.995ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12812024-08-16T07:16:55.995ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12822024-08-16T07:16:55.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12832024-08-16T07:16:55.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12842024-08-16T07:16:55.996ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12852024-08-16T07:16:55.996ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12862024-08-16T07:16:55.996ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12872024-08-16T07:16:55.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12882024-08-16T07:16:55.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12892024-08-16T07:16:55.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12902024-08-16T07:16:55.997ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12912024-08-16T07:16:55.998ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12922024-08-16T07:16:55.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12932024-08-16T07:16:55.999ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12942024-08-16T07:16:55.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12952024-08-16T07:16:55.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12962024-08-16T07:16:56.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12972024-08-16T07:16:56.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12982024-08-16T07:16:56.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12992024-08-16T07:16:56.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13002024-08-16T07:16:56.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13012024-08-16T07:16:56.001ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13022024-08-16T07:16:56.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13032024-08-16T07:16:56.029ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
13042024-08-16T07:16:56.029ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
13052024-08-16T07:16:56.029ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
13062024-08-16T07:16:56.029ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9b7c8509-bd38-45f1-8d60-80b57a8eb94b", "content-length": "476", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13072024-08-16T07:16:56.029ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
13082024-08-16T07:16:56.030ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "461e9b59-64c8-4b7b-934d-29e1e9ea4848", "content-length": "734", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13092024-08-16T07:16:56.030ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
13102024-08-16T07:16:56.030ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7c512b31-4a51-4c99-a71c-4e41e603a362", "content-length": "86", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13112024-08-16T07:16:56.030ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
13122024-08-16T07:16:56.030ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ff68b34b-0e09-443b-b2ca-27b3b2df794b", "content-length": "86", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13132024-08-16T07:16:56.030ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
13142024-08-16T07:16:56.030ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a2079cf8-f762-4eaa-bf7a-80d89dce9b36", "content-length": "80", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13152024-08-16T07:16:56.030ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
13162024-08-16T07:16:56.031ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ca0f00f4-5fec-43c5-88b1-da75c59e3d65", "content-length": "80", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13172024-08-16T07:16:56.031ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
13182024-08-16T07:16:56.032ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ff60b4e3-2b0b-425e-81a0-c9cf5e25403e", "content-length": "88", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13192024-08-16T07:16:56.032ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
13202024-08-16T07:16:56.032ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ffd14b41-4cae-4d4e-a853-dacf38465386", "content-length": "88", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13212024-08-16T07:16:56.032ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
13222024-08-16T07:16:56.032ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "39fce047-b718-4a19-be79-d4d816f0f819", "content-length": "702", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13232024-08-16T07:16:56.032ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
13242024-08-16T07:16:56.032ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6bac6c82-fb9f-4409-bc73-1dfbdab64345", "content-length": "727", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13252024-08-16T07:16:56.032ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
13262024-08-16T07:16:56.032ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c2897f6a-6d37-469a-9f70-9e29505d58de", "content-length": "729", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13272024-08-16T07:16:56.032ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
13282024-08-16T07:16:56.032ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ae969809-0a72-4cf5-93b9-ff333fc329b2", "content-length": "728", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13292024-08-16T07:16:56.032ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
13302024-08-16T07:16:56.033ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ce8e885a-0998-4474-9d94-6004729bd672", "content-length": "722", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13312024-08-16T07:16:56.033ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
13322024-08-16T07:16:56.034ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f9425d72-6e09-47cb-9685-d4fa99f3afd9", "content-length": "84", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13332024-08-16T07:16:56.034ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
13342024-08-16T07:16:56.034ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9ab5f144-6d58-4c93-9983-40913768d586", "content-length": "84", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13352024-08-16T07:16:56.034ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
13362024-08-16T07:16:56.034ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cb8a3837-af55-4cb7-bad7-ffd19be162b1", "content-length": "82", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13372024-08-16T07:16:56.034ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
13382024-08-16T07:16:56.034ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9e931a9a-d5a4-4bda-b6d9-3fc8d4d22e0b", "content-length": "82", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13392024-08-16T07:16:56.034ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
13402024-08-16T07:16:56.035ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fa0c5e06-6377-4aa2-89d2-2a358bb461a6", "content-length": "91", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13412024-08-16T07:16:56.035ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
13422024-08-16T07:16:56.035ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab7a5085-dc57-48d9-8990-9281162a016c", "content-length": "91", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13432024-08-16T07:16:56.035ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
13442024-08-16T07:16:56.035ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13452024-08-16T07:16:56.035ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
13462024-08-16T07:16:56.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13472024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
13482024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
13492024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13502024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13512024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "47aadb72-739d-4363-afed-2c9e98ae09fd", "content-length": "702", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13522024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
13532024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13542024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9b4c26f3-81c5-4062-b2bd-d3da1b9ff708", "content-length": "727", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13552024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
13562024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a134c497-f87a-4fc6-b245-ef1d3b5a28f6", "content-length": "729", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13572024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
13582024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7eaf0ca5-e576-47b6-95c8-c48769c27648", "content-length": "728", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
13592024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13602024-08-16T07:16:56.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13612024-08-16T07:16:56.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13622024-08-16T07:16:56.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13632024-08-16T07:16:56.037ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13642024-08-16T07:16:56.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
13652024-08-16T07:16:56.040ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13662024-08-16T07:16:56.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13672024-08-16T07:16:56.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13682024-08-16T07:16:56.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13692024-08-16T07:16:56.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13702024-08-16T07:16:56.041ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
13712024-08-16T07:16:56.041ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 76.815434ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13722024-08-16T07:16:56.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13732024-08-16T07:16:56.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13742024-08-16T07:16:56.041ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13752024-08-16T07:16:56.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13762024-08-16T07:16:56.042ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
13772024-08-16T07:16:56.042ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13782024-08-16T07:16:56.042ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
13792024-08-16T07:16:56.042ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 78.156965ms iteration = 2 status = {"generation":2}
13802024-08-16T07:16:56.042ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
13812024-08-16T07:16:56.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
13822024-08-16T07:16:56.043ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
13832024-08-16T07:16:56.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
13842024-08-16T07:16:56.043ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
13852024-08-16T07:16:56.043ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13862024-08-16T07:16:56.043ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
13872024-08-16T07:16:56.043ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 79.098486ms iteration = 2 status = {"generation":1}
13882024-08-16T07:16:56.043ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
13892024-08-16T07:16:56.107ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13902024-08-16T07:16:56.115ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13912024-08-16T07:16:56.160ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
13922024-08-16T07:16:56.160ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
13932024-08-16T07:16:56.179ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
13942024-08-16T07:16:56.194ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
13952024-08-16T07:16:56.219ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "44ad675f-efa9-4fd8-a944-a6672cdadc29", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13962024-08-16T07:16:56.219ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13972024-08-16T07:16:56.220ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "316412ed-c9d8-47ef-a622-ad6258dc4d88", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13982024-08-16T07:16:56.220ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13992024-08-16T07:16:56.220ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14002024-08-16T07:16:56.221ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
14012024-08-16T07:16:56.221ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 179.321092ms iteration = 3 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
14022024-08-16T07:16:56.233ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f968c00b-ed25-4f93-85f7-fb3a4c21e37d", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14032024-08-16T07:16:56.233ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14042024-08-16T07:16:56.235ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "067bf307-e11c-4684-a6ab-94c7810321d5", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14052024-08-16T07:16:56.235ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14062024-08-16T07:16:56.250ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7cc4b282-00bc-4da4-9fef-5e5582d2ab3f", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14072024-08-16T07:16:56.250ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14082024-08-16T07:16:56.251ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
14092024-08-16T07:16:56.251ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 208.460874ms iteration = 3 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
14102024-08-16T07:16:56.252ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/inventory", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "17fe63df-acdf-4e37-8528-9c7b1f01cff6", "content-length": "2360", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
14112024-08-16T07:16:56.252ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/omicron-zones
14122024-08-16T07:16:56.254ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/omicron-zones", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6bc20ae-ba1d-4776-8844-f983f80739a4", "content-length": "10314", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
14132024-08-16T07:16:56.255ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
14142024-08-16T07:16:56.255ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14152024-08-16T07:16:56.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14162024-08-16T07:16:56.256ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14172024-08-16T07:16:56.258ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
14182024-08-16T07:16:56.259ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
14192024-08-16T07:16:56.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
14202024-08-16T07:16:56.384ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = e22728bb-ea9e-439f-ac17-5b8b7f5fbd6d file = nexus/db-queries/src/db/datastore/inventory.rs:893
14212024-08-16T07:16:56.385ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = e22728bb-ea9e-439f-ac17-5b8b7f5fbd6d time_started = 2024-08-16 07:16:56.028491 UTC
14222024-08-16T07:16:56.385ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 421.298419ms iteration = 2 status = {"collection_id":"e22728bb-ea9e-439f-ac17-5b8b7f5fbd6d","time_done":"2024-08-16 07:16:56.255233 UTC","time_started":"2024-08-16 07:16:56.028491 UTC"}
14232024-08-16T07:16:56.385ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
14242024-08-16T07:16:56.385ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14252024-08-16T07:16:56.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14262024-08-16T07:16:56.387ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14272024-08-16T07:16:56.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14282024-08-16T07:16:56.388ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14292024-08-16T07:16:56.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14302024-08-16T07:16:56.390ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
14312024-08-16T07:16:56.390ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14322024-08-16T07:16:56.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14332024-08-16T07:16:56.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14342024-08-16T07:16:56.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14352024-08-16T07:16:56.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14362024-08-16T07:16:56.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14372024-08-16T07:16:56.421ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
14382024-08-16T07:16:56.421ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 35.729035ms iteration = 3 status = {"physical_disks_added":0}
14392024-08-16T07:16:56.737ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
14402024-08-16T07:16:56.738ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
14412024-08-16T07:16:56.739ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
14422024-08-16T07:16:56.739ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
14432024-08-16T07:16:56.740ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14442024-08-16T07:16:56.742ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, lookup_type: ById(e1b0d583-7b20-4a4b-97f9-9f83300aeb7a) } result = Ok(())
14452024-08-16T07:16:56.742ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:723
14462024-08-16T07:16:56.742ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14472024-08-16T07:16:56.743ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14482024-08-16T07:16:56.744ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14492024-08-16T07:16:56.744ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14502024-08-16T07:16:56.745ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14512024-08-16T07:16:56.745ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14522024-08-16T07:16:56.746ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14532024-08-16T07:16:56.746ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14542024-08-16T07:16:56.747ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14552024-08-16T07:16:56.747ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14562024-08-16T07:16:56.748ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14572024-08-16T07:16:56.748ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14582024-08-16T07:16:56.749ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14592024-08-16T07:16:56.752ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
14602024-08-16T07:16:56.752ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14612024-08-16T07:16:56.752ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14622024-08-16T07:16:56.753ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14632024-08-16T07:16:56.753ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14642024-08-16T07:16:56.754ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14652024-08-16T07:16:56.754ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14662024-08-16T07:16:56.755ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14672024-08-16T07:16:56.758ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
14682024-08-16T07:16:56.758ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14692024-08-16T07:16:56.758ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14702024-08-16T07:16:56.759ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14712024-08-16T07:16:56.759ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14722024-08-16T07:16:56.760ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14732024-08-16T07:16:56.760ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14742024-08-16T07:16:56.761ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14752024-08-16T07:16:56.761ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14762024-08-16T07:16:56.761ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14772024-08-16T07:16:56.762ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14782024-08-16T07:16:56.762ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14792024-08-16T07:16:56.762ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14802024-08-16T07:16:56.763ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14812024-08-16T07:16:56.763ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14822024-08-16T07:16:56.764ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14832024-08-16T07:16:56.767ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
14842024-08-16T07:16:56.767ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14852024-08-16T07:16:56.767ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14862024-08-16T07:16:56.768ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14872024-08-16T07:16:56.768ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14882024-08-16T07:16:56.769ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14892024-08-16T07:16:56.769ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14902024-08-16T07:16:56.770ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14912024-08-16T07:16:56.770ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14922024-08-16T07:16:56.771ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14932024-08-16T07:16:56.771ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14942024-08-16T07:16:56.772ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14952024-08-16T07:16:56.772ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14962024-08-16T07:16:56.773ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14972024-08-16T07:16:56.773ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14982024-08-16T07:16:56.774ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14992024-08-16T07:16:56.777ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15002024-08-16T07:16:56.777ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15012024-08-16T07:16:56.777ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15022024-08-16T07:16:56.778ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15032024-08-16T07:16:56.778ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15042024-08-16T07:16:56.779ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15052024-08-16T07:16:56.779ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15062024-08-16T07:16:56.779ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15072024-08-16T07:16:56.782ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
15082024-08-16T07:16:56.782ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15092024-08-16T07:16:56.782ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15102024-08-16T07:16:56.785ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15112024-08-16T07:16:56.785ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15122024-08-16T07:16:56.786ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15132024-08-16T07:16:56.786ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15142024-08-16T07:16:56.787ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15152024-08-16T07:16:56.787ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15162024-08-16T07:16:56.788ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15172024-08-16T07:16:56.788ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15182024-08-16T07:16:56.789ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15192024-08-16T07:16:56.789ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15202024-08-16T07:16:56.790ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15212024-08-16T07:16:56.790ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15222024-08-16T07:16:56.791ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15232024-08-16T07:16:56.791ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15242024-08-16T07:16:56.792ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15252024-08-16T07:16:56.795ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15262024-08-16T07:16:56.795ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15272024-08-16T07:16:56.795ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15282024-08-16T07:16:56.796ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15292024-08-16T07:16:56.796ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15302024-08-16T07:16:56.797ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15312024-08-16T07:16:56.797ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15322024-08-16T07:16:56.797ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15332024-08-16T07:16:56.800ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
15342024-08-16T07:16:56.800ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15352024-08-16T07:16:56.800ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15362024-08-16T07:16:56.803ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 036a4ce6-ea03-4027-b4fc-46b08e5aab80, kind: Service { id: 0d900881-9285-4dbf-910f-5e4676c8f133 }, name: Name("nexus-0d900881-9285-4dbf-910f-5e4676c8f133"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d720059-2cc6-4a99-8f2a-da62f41fe70c, kind: Service { id: 09eed6fc-f2ea-4ebd-a66c-d8895818c00c }, name: Name("nexus-09eed6fc-f2ea-4ebd-a66c-d8895818c00c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: addeeb4f-a7d0-4d63-8259-b305b18b5ab1, kind: Service { id: 30e79e9e-c63b-4bdf-99e7-c71a02ecefc5 }, name: Name("nexus-30e79e9e-c63b-4bdf-99e7-c71a02ecefc5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0394c19d-c776-4986-aadf-3eb1689e7bef, kind: Service { id: dec19c15-1a2d-47ac-9b9e-9f424d3a3464 }, name: Name("external-dns-dec19c15-1a2d-47ac-9b9e-9f424d3a3464"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e9bad3ae-7417-4456-8d3e-34e4cbaa5de1, kind: Service { id: f9649eef-936b-4765-9810-da8662275db5 }, name: Name("external-dns-f9649eef-936b-4765-9810-da8662275db5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 132])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
15372024-08-16T07:16:56.804ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15382024-08-16T07:16:56.804ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15392024-08-16T07:16:56.804ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15402024-08-16T07:16:56.806ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
15412024-08-16T07:16:56.806ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15422024-08-16T07:16:56.806ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15432024-08-16T07:16:56.807ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
15442024-08-16T07:16:56.807ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0394c19d-c776-4986-aadf-3eb1689e7bef, kind: Service { id: dec19c15-1a2d-47ac-9b9e-9f424d3a3464 }, name: Name("external-dns-dec19c15-1a2d-47ac-9b9e-9f424d3a3464"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e9bad3ae-7417-4456-8d3e-34e4cbaa5de1, kind: Service { id: f9649eef-936b-4765-9810-da8662275db5 }, name: Name("external-dns-f9649eef-936b-4765-9810-da8662275db5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 132])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 036a4ce6-ea03-4027-b4fc-46b08e5aab80, kind: Service { id: 0d900881-9285-4dbf-910f-5e4676c8f133 }, name: Name("nexus-0d900881-9285-4dbf-910f-5e4676c8f133"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d720059-2cc6-4a99-8f2a-da62f41fe70c, kind: Service { id: 09eed6fc-f2ea-4ebd-a66c-d8895818c00c }, name: Name("nexus-09eed6fc-f2ea-4ebd-a66c-d8895818c00c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: addeeb4f-a7d0-4d63-8259-b305b18b5ab1, kind: Service { id: 30e79e9e-c63b-4bdf-99e7-c71a02ecefc5 }, name: Name("nexus-30e79e9e-c63b-4bdf-99e7-c71a02ecefc5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
15452024-08-16T07:16:56.807ZDEBGnexus (InternalApi): resolved 2 rules for sleds
15462024-08-16T07:16:56.849ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, time_created: 2024-08-16T07:16:52.894284Z, time_modified: 2024-08-16T07:16:52.894284Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
15472024-08-16T07:16:56.849ZDEBGnexus (InternalApi): sending firewall rules to sled agents
15482024-08-16T07:16:56.849ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15492024-08-16T07:16:56.850ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15502024-08-16T07:16:56.853ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
15512024-08-16T07:16:56.853ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
15522024-08-16T07:16:56.855ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15532024-08-16T07:16:56.858ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
15542024-08-16T07:16:56.888ZDEBGnexus (InternalApi): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15552024-08-16T07:16:56.889ZDEBGnexus (InternalApi): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e7a2c538-a284-4538-a842-3ab1c0c4445d", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
15562024-08-16T07:16:56.890ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
15572024-08-16T07:16:56.890ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
15582024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /
15592024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access
15602024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path}
15612024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth
15622024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm
15632024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success
15642024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token
15652024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify
15662024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes
15672024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes
15682024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe}
15692024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe}
15702024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images
15712024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login
15722024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local
15732024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}
15742024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name}
15752024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
15762024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path}
15772024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path}
15782024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new
15792024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path}
15802024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path}
15812024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization
15822024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates
15832024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates
15842024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate}
15852024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate}
15862024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks
15872024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks
15882024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk}
15892024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}
15902024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write
15912024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start
15922024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop
15932024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize
15942024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric}
15952024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips
15962024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips
15972024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip}
15982024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip}
15992024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip}
16002024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach
16012024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach
16022024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups
16032024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id}
16042024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images
16052024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images
16062024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image}
16072024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image}
16082024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote
16092024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote
16102024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances
16112024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances
16122024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}
16132024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}
16142024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks
16152024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach
16162024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach
16172024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips
16182024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
16192024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
16202024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot
16212024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console
16222024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream
16232024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys
16242024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start
16252024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop
16262024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools
16272024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool}
16282024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local
16292024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout
16302024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me
16312024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups
16322024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys
16332024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys
16342024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
16352024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key}
16362024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name}
16372024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces
16382024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces
16392024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface}
16402024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface}
16412024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface}
16422024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping
16432024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy
16442024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy
16452024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects
16462024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects
16472024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project}
16482024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}
16492024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}
16502024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy
16512024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy
16522024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots
16532024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots
16542024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot}
16552024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot}
16562024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks
16572024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id}
16582024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks
16592024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id}
16602024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds
16612024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds
16622024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}
16632024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
16642024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
16652024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
16662024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized
16672024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port
16682024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
16692024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings
16702024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status
16712024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches
16722024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id}
16732024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers
16742024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users
16752024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
16762024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
16772024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml
16782024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider}
16792024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools
16802024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools
16812024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}
16822024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}
16832024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}
16842024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges
16852024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
16862024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
16872024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos
16882024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos
16892024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
16902024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
16912024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization
16922024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service
16932024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges
16942024-08-16T07:16:56.901ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add
16952024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove
16962024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name}
16972024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot
16982024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot
16992024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
17002024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
17012024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list
17022024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list
17032024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable
17042024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable
17052024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status
17062024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp
17072024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp
17082024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp
17092024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce
17102024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce
17112024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce
17122024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history
17132024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4
17142024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status
17152024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address
17162024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address
17172024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
17182024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings
17192024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings
17202024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings
17212024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port}
17222024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy
17232024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy
17242024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles
17252024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name}
17262024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas
17272024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos
17282024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos
17292024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo}
17302024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}
17312024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools
17322024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy
17332024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy
17342024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas
17352024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas
17362024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository
17372024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version}
17382024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users
17392024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id}
17402024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin
17412024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user}
17422024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos
17432024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo}
17442024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/timeseries/query
17452024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/timeseries/schema
17462024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users
17472024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization
17482024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules
17492024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules
17502024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes
17512024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes
17522024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route}
17532024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route}
17542024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route}
17552024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers
17562024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers
17572024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router}
17582024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router}
17592024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router}
17602024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets
17612024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets
17622024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet}
17632024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}
17642024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet}
17652024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
17662024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs
17672024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs
17682024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc}
17692024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc}
17702024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc}
17712024-08-16T07:16:56.902ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:205 local_addr = 172.30.2.6:443
17722024-08-16T07:16:56.902ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
17732024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /
17742024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access
17752024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path}
17762024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth
17772024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm
17782024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success
17792024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token
17802024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify
17812024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes
17822024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes
17832024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe}
17842024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe}
17852024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images
17862024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login
17872024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local
17882024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}
17892024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name}
17902024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
17912024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path}
17922024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path}
17932024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new
17942024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path}
17952024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path}
17962024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization
17972024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates
17982024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates
17992024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate}
18002024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate}
18012024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks
18022024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks
18032024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk}
18042024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}
18052024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write
18062024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start
18072024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop
18082024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize
18092024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric}
18102024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips
18112024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips
18122024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip}
18132024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip}
18142024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip}
18152024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach
18162024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach
18172024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups
18182024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id}
18192024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images
18202024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images
18212024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image}
18222024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image}
18232024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote
18242024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote
18252024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances
18262024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances
18272024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}
18282024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}
18292024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks
18302024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach
18312024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach
18322024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips
18332024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
18342024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
18352024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot
18362024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console
18372024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream
18382024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys
18392024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start
18402024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop
18412024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools
18422024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool}
18432024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local
18442024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout
18452024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me
18462024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups
18472024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys
18482024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys
18492024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
18502024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key}
18512024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name}
18522024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces
18532024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces
18542024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface}
18552024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface}
18562024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface}
18572024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping
18582024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy
18592024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy
18602024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects
18612024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects
18622024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project}
18632024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}
18642024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}
18652024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy
18662024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy
18672024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots
18682024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots
18692024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot}
18702024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot}
18712024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks
18722024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id}
18732024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks
18742024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id}
18752024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds
18762024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds
18772024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}
18782024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
18792024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
18802024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
18812024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized
18822024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port
18832024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
18842024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings
18852024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status
18862024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches
18872024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id}
18882024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers
18892024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users
18902024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
18912024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
18922024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml
18932024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider}
18942024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools
18952024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools
18962024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}
18972024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}
18982024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}
18992024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges
19002024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
19012024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
19022024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos
19032024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos
19042024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
19052024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
19062024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization
19072024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service
19082024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges
19092024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add
19102024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove
19112024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name}
19122024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot
19132024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot
19142024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
19152024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
19162024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list
19172024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list
19182024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable
19192024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable
19202024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status
19212024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp
19222024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp
19232024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp
19242024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce
19252024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce
19262024-08-16T07:16:56.906ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce
19272024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history
19282024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4
19292024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status
19302024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address
19312024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address
19322024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
19332024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings
19342024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings
19352024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings
19362024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port}
19372024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy
19382024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy
19392024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles
19402024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name}
19412024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas
19422024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos
19432024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos
19442024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo}
19452024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}
19462024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools
19472024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy
19482024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy
19492024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas
19502024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas
19512024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository
19522024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version}
19532024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users
19542024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id}
19552024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin
19562024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user}
19572024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos
19582024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo}
19592024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/timeseries/query
19602024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/timeseries/schema
19612024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users
19622024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization
19632024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules
19642024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules
19652024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes
19662024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes
19672024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route}
19682024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route}
19692024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route}
19702024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers
19712024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers
19722024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router}
19732024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router}
19742024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router}
19752024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets
19762024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets
19772024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet}
19782024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}
19792024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet}
19802024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
19812024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs
19822024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs
19832024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc}
19842024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc}
19852024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc}
19862024-08-16T07:16:56.907ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::b]:12228
19872024-08-16T07:16:56.907ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
19882024-08-16T07:16:56.907ZDEBGnexus (nexus-producer-server): registered DTrace probes
19892024-08-16T07:16:56.910ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:46346 method = GET path = /{producer_id}
19902024-08-16T07:16:56.910ZINFOnexus (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::b]:46346
19912024-08-16T07:16:56.910ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:46346
19922024-08-16T07:16:56.910ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:46346
19932024-08-16T07:16:56.910ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
19942024-08-16T07:16:56.910ZDEBGnexus (nexus-producer-server): starting producer registration task
19952024-08-16T07:16:56.911ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:46346 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
19962024-08-16T07:16:56.911ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
19972024-08-16T07:16:56.911ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
19982024-08-16T07:16:56.924ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" } server_name = recovery.sys.oxide.test silo_id = 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071
19992024-08-16T07:16:56.934ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = 172.30.2.6:443 remote_addr = 10.151.2.100:35534
20002024-08-16T07:16:56.939ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20012024-08-16T07:16:56.940ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20022024-08-16T07:16:56.941ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20032024-08-16T07:16:56.941ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20042024-08-16T07:16:56.942ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20052024-08-16T07:16:56.943ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20062024-08-16T07:16:56.943ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
20072024-08-16T07:16:56.943ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:49017
20082024-08-16T07:16:56.944ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20092024-08-16T07:16:56.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:49017 req_id = aa668145-e346-4ca5-9150-c8e5c736453d roles = RoleSet { roles: {} } uri = /metrics/producers
20102024-08-16T07:16:56.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:49017 req_id = aa668145-e346-4ca5-9150-c8e5c736453d resource = Database result = Ok(()) uri = /metrics/producers
20112024-08-16T07:16:56.945ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ByName("recovery") } result = Ok(())
20122024-08-16T07:16:56.945ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20132024-08-16T07:16:56.945ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20142024-08-16T07:16:56.946ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20152024-08-16T07:16:56.946ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20162024-08-16T07:16:56.947ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20172024-08-16T07:16:56.949ZDEBGnexus (ExternalAuthn): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ByName("recovery") } result = Ok(())
20182024-08-16T07:16:56.949ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20192024-08-16T07:16:56.949ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20202024-08-16T07:16:56.951ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20212024-08-16T07:16:56.951ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20222024-08-16T07:16:56.952ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20232024-08-16T07:16:56.952ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20242024-08-16T07:16:56.953ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:902 latency_us = 9704 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:49017 req_id = aa668145-e346-4ca5-9150-c8e5c736453d response_code = 503 uri = /metrics/producers
20252024-08-16T07:16:56.953ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 503, headers: {"content-type": "application/json", "x-request-id": "aa668145-e346-4ca5-9150-c8e5c736453d", "content-length": "133", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
20262024-08-16T07:16:56.953ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20272024-08-16T07:16:56.954ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ByName("recovery") }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ByName("recovery") } result = Ok(())
20282024-08-16T07:16:56.954ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20292024-08-16T07:16:56.954ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20302024-08-16T07:16:56.955ZWARNnexus (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 186.195119ms error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"aa668145-e346-4ca5-9150-c8e5c736453d\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Fri, 16 Aug 2024 07:16:56 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"aa668145-e346-4ca5-9150-c8e5c736453d\\" }" file = oximeter/producer/src/lib.rs:424
20312024-08-16T07:16:57.173ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
20322024-08-16T07:16:57.173ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:62134
20332024-08-16T07:16:57.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62134 req_id = dffb642e-94fb-43bc-81b9-6c90a0c9ef10 roles = RoleSet { roles: {} } uri = /metrics/producers
20342024-08-16T07:16:57.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62134 req_id = dffb642e-94fb-43bc-81b9-6c90a0c9ef10 resource = Database result = Ok(()) uri = /metrics/producers
20352024-08-16T07:16:57.174ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:902 latency_us = 1313 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62134 req_id = dffb642e-94fb-43bc-81b9-6c90a0c9ef10 response_code = 503 uri = /metrics/producers
20362024-08-16T07:16:57.174ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 503, headers: {"content-type": "application/json", "x-request-id": "dffb642e-94fb-43bc-81b9-6c90a0c9ef10", "content-length": "133", "date": "Fri, 16 Aug 2024 07:16:56 GMT"} })
20372024-08-16T07:16:57.176ZWARNnexus (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 538.877743ms error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"dffb642e-94fb-43bc-81b9-6c90a0c9ef10\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Fri, 16 Aug 2024 07:16:56 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"dffb642e-94fb-43bc-81b9-6c90a0c9ef10\\" }" file = oximeter/producer/src/lib.rs:424
20382024-08-16T07:16:57.664ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20392024-08-16T07:16:57.664ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20402024-08-16T07:16:57.665ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20412024-08-16T07:16:57.666ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20422024-08-16T07:16:57.667ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20432024-08-16T07:16:57.667ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20442024-08-16T07:16:57.668ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20452024-08-16T07:16:57.668ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20462024-08-16T07:16:57.669ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20472024-08-16T07:16:57.670ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
20482024-08-16T07:16:57.670ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20492024-08-16T07:16:57.670ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20502024-08-16T07:16:57.671ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20512024-08-16T07:16:57.672ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSessionList result = Ok(())
20522024-08-16T07:16:57.672ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20532024-08-16T07:16:57.673ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20542024-08-16T07:16:57.675ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 736105 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:35534 req_id = 7b8dee3e-ef77-4b2e-87ae-3a9f1b4e8a01 response_code = 204 uri = /v1/login/recovery/local
20552024-08-16T07:16:57.746ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
20562024-08-16T07:16:57.746ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:60093
20572024-08-16T07:16:57.746ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" } server_name = recovery.sys.oxide.test silo_id = 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071
20582024-08-16T07:16:57.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60093 req_id = 07ca4e2d-7be9-4310-b5f2-05bfad0a73ae roles = RoleSet { roles: {} } uri = /metrics/producers
20592024-08-16T07:16:57.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60093 req_id = 07ca4e2d-7be9-4310-b5f2-05bfad0a73ae resource = Database result = Ok(()) uri = /metrics/producers
20602024-08-16T07:16:57.748ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:902 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60093 req_id = 07ca4e2d-7be9-4310-b5f2-05bfad0a73ae response_code = 503 uri = /metrics/producers
20612024-08-16T07:16:57.749ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 503, headers: {"content-type": "application/json", "x-request-id": "07ca4e2d-7be9-4310-b5f2-05bfad0a73ae", "content-length": "133", "date": "Fri, 16 Aug 2024 07:16:57 GMT"} })
20622024-08-16T07:16:57.750ZWARNnexus (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 814.424059ms error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"07ca4e2d-7be9-4310-b5f2-05bfad0a73ae\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Fri, 16 Aug 2024 07:16:57 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"07ca4e2d-7be9-4310-b5f2-05bfad0a73ae\\" }" file = oximeter/producer/src/lib.rs:424
20632024-08-16T07:16:57.756ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = 172.30.2.6:443 remote_addr = 10.151.2.100:40839
20642024-08-16T07:16:57.758ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20652024-08-16T07:16:57.758ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20662024-08-16T07:16:57.760ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20672024-08-16T07:16:57.760ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20682024-08-16T07:16:57.761ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20692024-08-16T07:16:57.762ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("token = \\"cedc205641a616d175e525d1133fce46875713d9\\"") } result = Ok(())
20702024-08-16T07:16:57.762ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20712024-08-16T07:16:57.762ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20722024-08-16T07:16:57.763ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20732024-08-16T07:16:57.763ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20742024-08-16T07:16:57.764ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20752024-08-16T07:16:57.764ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20762024-08-16T07:16:57.765ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20772024-08-16T07:16:57.765ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20782024-08-16T07:16:57.766ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20792024-08-16T07:16:57.767ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
20802024-08-16T07:16:57.767ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20812024-08-16T07:16:57.767ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20822024-08-16T07:16:57.768ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20832024-08-16T07:16:57.769ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("cedc205641a616d175e525d1133fce46875713d9") } result = Ok(())
20842024-08-16T07:16:57.769ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20852024-08-16T07:16:57.769ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20862024-08-16T07:16:57.772ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20872024-08-16T07:16:57.772ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20882024-08-16T07:16:57.774ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20892024-08-16T07:16:57.774ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20902024-08-16T07:16:57.775ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20912024-08-16T07:16:57.776ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20922024-08-16T07:16:57.776ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20932024-08-16T07:16:57.776ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20942024-08-16T07:16:57.777ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
20952024-08-16T07:16:57.778ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
20962024-08-16T07:16:57.778ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20972024-08-16T07:16:57.778ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
20982024-08-16T07:16:57.779ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
20992024-08-16T07:16:57.779ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21002024-08-16T07:16:57.780ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21012024-08-16T07:16:57.780ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21022024-08-16T07:16:57.781ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21032024-08-16T07:16:57.782ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(())
21042024-08-16T07:16:57.783ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:40839 req_id = 7a743e77-d786-4c80-b1c2-317ab418c824 roles = RoleSet { roles: {} } uri = /v1/projects
21052024-08-16T07:16:57.783ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:40839 req_id = 7a743e77-d786-4c80-b1c2-317ab418c824 resource = Database result = Ok(()) uri = /v1/projects
21062024-08-16T07:16:57.786ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:40839 req_id = 7a743e77-d786-4c80-b1c2-317ab418c824 roles = RoleSet { roles: {} } uri = /v1/projects
21072024-08-16T07:16:57.786ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:40839 req_id = 7a743e77-d786-4c80-b1c2-317ab418c824 resource = Database result = Ok(()) uri = /v1/projects
21082024-08-16T07:16:57.787ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:40839 req_id = 7a743e77-d786-4c80-b1c2-317ab418c824 roles = RoleSet { roles: {} } uri = /v1/projects
21092024-08-16T07:16:57.788ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:40839 req_id = 7a743e77-d786-4c80-b1c2-317ab418c824 resource = Database result = Ok(()) uri = /v1/projects
21102024-08-16T07:16:57.789ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:40839 req_id = 7a743e77-d786-4c80-b1c2-317ab418c824 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/projects
21112024-08-16T07:16:57.792ZDEBGnexus (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:40839 req_id = 7a743e77-d786-4c80-b1c2-317ab418c824 resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(()) uri = /v1/projects
21122024-08-16T07:16:57.792ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:40839 req_id = 7a743e77-d786-4c80-b1c2-317ab418c824 roles = RoleSet { roles: {} } uri = /v1/projects
21132024-08-16T07:16:57.792ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:40839 req_id = 7a743e77-d786-4c80-b1c2-317ab418c824 resource = Database result = Ok(()) uri = /v1/projects
21142024-08-16T07:16:57.794ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 38459 local_addr = 172.30.2.6:443 method = GET remote_addr = 10.151.2.100:40839 req_id = 7a743e77-d786-4c80-b1c2-317ab418c824 response_code = 200 uri = /v1/projects
21152024-08-16T07:16:57.821ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21162024-08-16T07:16:57.821ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21172024-08-16T07:16:57.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21182024-08-16T07:16:57.822ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21192024-08-16T07:16:57.823ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21202024-08-16T07:16:57.824ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("token = \\"cedc205641a616d175e525d1133fce46875713d9\\"") } result = Ok(())
21212024-08-16T07:16:57.824ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21222024-08-16T07:16:57.824ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21232024-08-16T07:16:57.825ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21242024-08-16T07:16:57.826ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21252024-08-16T07:16:57.827ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21262024-08-16T07:16:57.827ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21272024-08-16T07:16:57.828ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21282024-08-16T07:16:57.828ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21292024-08-16T07:16:57.829ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21302024-08-16T07:16:57.830ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
21312024-08-16T07:16:57.830ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21322024-08-16T07:16:57.831ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21332024-08-16T07:16:57.832ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21342024-08-16T07:16:57.833ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("cedc205641a616d175e525d1133fce46875713d9") } result = Ok(())
21352024-08-16T07:16:57.833ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21362024-08-16T07:16:57.833ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21372024-08-16T07:16:57.836ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21382024-08-16T07:16:57.836ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21392024-08-16T07:16:57.837ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21402024-08-16T07:16:57.837ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21412024-08-16T07:16:57.838ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21422024-08-16T07:16:57.838ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21432024-08-16T07:16:57.839ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21442024-08-16T07:16:57.839ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21452024-08-16T07:16:57.840ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21462024-08-16T07:16:57.841ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
21472024-08-16T07:16:57.841ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21482024-08-16T07:16:57.841ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21492024-08-16T07:16:57.842ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21502024-08-16T07:16:57.842ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21512024-08-16T07:16:57.843ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21522024-08-16T07:16:57.843ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21532024-08-16T07:16:57.844ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21542024-08-16T07:16:57.845ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(())
21552024-08-16T07:16:57.845ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 5233433d-6a6f-4f94-a9a3-dcb6be48d977 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
21562024-08-16T07:16:57.845ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 5233433d-6a6f-4f94-a9a3-dcb6be48d977 resource = Database result = Ok(()) uri = /v1/system/ip-pools
21572024-08-16T07:16:57.847ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 5233433d-6a6f-4f94-a9a3-dcb6be48d977 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
21582024-08-16T07:16:57.847ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 5233433d-6a6f-4f94-a9a3-dcb6be48d977 resource = Database result = Ok(()) uri = /v1/system/ip-pools
21592024-08-16T07:16:57.848ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 5233433d-6a6f-4f94-a9a3-dcb6be48d977 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/system/ip-pools
21602024-08-16T07:16:57.850ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 5233433d-6a6f-4f94-a9a3-dcb6be48d977 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools
21612024-08-16T07:16:57.850ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 5233433d-6a6f-4f94-a9a3-dcb6be48d977 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
21622024-08-16T07:16:57.850ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 5233433d-6a6f-4f94-a9a3-dcb6be48d977 resource = Database result = Ok(()) uri = /v1/system/ip-pools
21632024-08-16T07:16:57.852ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 31747 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 5233433d-6a6f-4f94-a9a3-dcb6be48d977 response_code = 201 uri = /v1/system/ip-pools
21642024-08-16T07:16:57.858ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21652024-08-16T07:16:57.859ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21662024-08-16T07:16:57.859ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21672024-08-16T07:16:57.860ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21682024-08-16T07:16:57.860ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21692024-08-16T07:16:57.861ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("token = \\"cedc205641a616d175e525d1133fce46875713d9\\"") } result = Ok(())
21702024-08-16T07:16:57.861ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21712024-08-16T07:16:57.862ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21722024-08-16T07:16:57.862ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21732024-08-16T07:16:57.863ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21742024-08-16T07:16:57.863ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21752024-08-16T07:16:57.863ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21762024-08-16T07:16:57.864ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21772024-08-16T07:16:57.864ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21782024-08-16T07:16:57.865ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21792024-08-16T07:16:57.866ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
21802024-08-16T07:16:57.866ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21812024-08-16T07:16:57.866ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21822024-08-16T07:16:57.867ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21832024-08-16T07:16:57.868ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("cedc205641a616d175e525d1133fce46875713d9") } result = Ok(())
21842024-08-16T07:16:57.868ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21852024-08-16T07:16:57.868ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21862024-08-16T07:16:57.870ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21872024-08-16T07:16:57.870ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21882024-08-16T07:16:57.871ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21892024-08-16T07:16:57.872ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21902024-08-16T07:16:57.873ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21912024-08-16T07:16:57.873ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21922024-08-16T07:16:57.874ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21932024-08-16T07:16:57.874ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21942024-08-16T07:16:57.874ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
21952024-08-16T07:16:57.875ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
21962024-08-16T07:16:57.876ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21972024-08-16T07:16:57.876ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
21982024-08-16T07:16:57.876ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
21992024-08-16T07:16:57.876ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22002024-08-16T07:16:57.877ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22012024-08-16T07:16:57.877ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22022024-08-16T07:16:57.878ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22032024-08-16T07:16:57.879ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(())
22042024-08-16T07:16:57.880ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22052024-08-16T07:16:57.880ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22062024-08-16T07:16:57.881ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22072024-08-16T07:16:57.881ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22082024-08-16T07:16:57.882ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22092024-08-16T07:16:57.883ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22102024-08-16T07:16:57.884ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/system/ip-pools/default/silos
22112024-08-16T07:16:57.886ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = IpPool { parent: Fleet, key: d71eb967-77f8-4ea7-8ed9-36ed81a2b49f, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
22122024-08-16T07:16:57.886ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22132024-08-16T07:16:57.886ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22142024-08-16T07:16:57.887ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22152024-08-16T07:16:57.888ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22162024-08-16T07:16:57.889ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22172024-08-16T07:16:57.889ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22182024-08-16T07:16:57.890ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22192024-08-16T07:16:57.890ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22202024-08-16T07:16:57.892ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22212024-08-16T07:16:57.892ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22222024-08-16T07:16:57.894ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/system/ip-pools/default/silos
22232024-08-16T07:16:57.895ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
22242024-08-16T07:16:57.895ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22252024-08-16T07:16:57.895ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22262024-08-16T07:16:57.897ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22272024-08-16T07:16:57.897ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22282024-08-16T07:16:57.899ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/system/ip-pools/default/silos
22292024-08-16T07:16:57.900ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools/default/silos
22302024-08-16T07:16:57.900ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
22312024-08-16T07:16:57.901ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
22322024-08-16T07:16:57.939ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 81441 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = f58e8d3b-eedb-4fdd-9e45-4931b1810337 response_code = 201 uri = /v1/system/ip-pools/default/silos
22332024-08-16T07:16:57.942ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22342024-08-16T07:16:57.942ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22352024-08-16T07:16:57.943ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22362024-08-16T07:16:57.943ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22372024-08-16T07:16:57.944ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22382024-08-16T07:16:57.945ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("token = \\"cedc205641a616d175e525d1133fce46875713d9\\"") } result = Ok(())
22392024-08-16T07:16:57.945ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22402024-08-16T07:16:57.945ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22412024-08-16T07:16:57.946ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22422024-08-16T07:16:57.946ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22432024-08-16T07:16:57.947ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22442024-08-16T07:16:57.947ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22452024-08-16T07:16:57.948ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22462024-08-16T07:16:57.948ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22472024-08-16T07:16:57.949ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22482024-08-16T07:16:57.950ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
22492024-08-16T07:16:57.950ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22502024-08-16T07:16:57.950ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22512024-08-16T07:16:57.951ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22522024-08-16T07:16:57.952ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("cedc205641a616d175e525d1133fce46875713d9") } result = Ok(())
22532024-08-16T07:16:57.952ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22542024-08-16T07:16:57.952ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22552024-08-16T07:16:57.954ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22562024-08-16T07:16:57.954ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22572024-08-16T07:16:57.955ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22582024-08-16T07:16:57.955ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22592024-08-16T07:16:57.956ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22602024-08-16T07:16:57.956ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22612024-08-16T07:16:57.956ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22622024-08-16T07:16:57.957ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22632024-08-16T07:16:57.957ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22642024-08-16T07:16:57.959ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
22652024-08-16T07:16:57.959ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22662024-08-16T07:16:57.959ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22672024-08-16T07:16:57.959ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22682024-08-16T07:16:57.960ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22692024-08-16T07:16:57.960ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22702024-08-16T07:16:57.961ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22712024-08-16T07:16:57.961ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22722024-08-16T07:16:57.962ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(())
22732024-08-16T07:16:57.962ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
22742024-08-16T07:16:57.962ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
22752024-08-16T07:16:57.964ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
22762024-08-16T07:16:57.964ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
22772024-08-16T07:16:57.965ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
22782024-08-16T07:16:57.965ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
22792024-08-16T07:16:57.967ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
22802024-08-16T07:16:57.968ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f resource = IpPool { parent: Fleet, key: d71eb967-77f8-4ea7-8ed9-36ed81a2b49f, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
22812024-08-16T07:16:57.968ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
22822024-08-16T07:16:57.969ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
22832024-08-16T07:16:57.970ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
22842024-08-16T07:16:57.970ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
22852024-08-16T07:16:57.970ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
22862024-08-16T07:16:57.970ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
22872024-08-16T07:16:57.972ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
22882024-08-16T07:16:57.972ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
22892024-08-16T07:16:57.973ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
22902024-08-16T07:16:57.974ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f resource = IpPool { parent: Fleet, key: d71eb967-77f8-4ea7-8ed9-36ed81a2b49f, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
22912024-08-16T07:16:57.982ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 40670 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1101f484-793f-4cc3-a33b-ec73b30f543f response_code = 201 uri = /v1/system/ip-pools/default/ranges/add
22922024-08-16T07:16:57.984ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22932024-08-16T07:16:57.984ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22942024-08-16T07:16:57.985ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22952024-08-16T07:16:57.985ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
22962024-08-16T07:16:57.986ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
22972024-08-16T07:16:57.987ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("token = \\"cedc205641a616d175e525d1133fce46875713d9\\"") } result = Ok(())
22982024-08-16T07:16:57.987ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22992024-08-16T07:16:57.987ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23002024-08-16T07:16:57.988ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23012024-08-16T07:16:57.988ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23022024-08-16T07:16:57.989ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23032024-08-16T07:16:57.989ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23042024-08-16T07:16:57.989ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23052024-08-16T07:16:57.990ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23062024-08-16T07:16:57.990ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23072024-08-16T07:16:57.991ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
23082024-08-16T07:16:57.991ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23092024-08-16T07:16:57.992ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23102024-08-16T07:16:57.992ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23112024-08-16T07:16:57.993ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("cedc205641a616d175e525d1133fce46875713d9") } result = Ok(())
23122024-08-16T07:16:57.993ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23132024-08-16T07:16:57.994ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23142024-08-16T07:16:57.997ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23152024-08-16T07:16:57.997ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23162024-08-16T07:16:57.998ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23172024-08-16T07:16:57.998ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23182024-08-16T07:16:57.999ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23192024-08-16T07:16:57.999ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23202024-08-16T07:16:58.000ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23212024-08-16T07:16:58.000ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23222024-08-16T07:16:58.001ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23232024-08-16T07:16:58.002ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
23242024-08-16T07:16:58.002ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23252024-08-16T07:16:58.002ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23262024-08-16T07:16:58.003ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23272024-08-16T07:16:58.003ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23282024-08-16T07:16:58.004ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23292024-08-16T07:16:58.004ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23302024-08-16T07:16:58.005ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23312024-08-16T07:16:58.006ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(())
23322024-08-16T07:16:58.006ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23332024-08-16T07:16:58.006ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23342024-08-16T07:16:58.007ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23352024-08-16T07:16:58.007ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23362024-08-16T07:16:58.008ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23372024-08-16T07:16:58.009ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23382024-08-16T07:16:58.010ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23392024-08-16T07:16:58.010ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23402024-08-16T07:16:58.011ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/system/silos/recovery/quotas
23412024-08-16T07:16:58.012ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
23422024-08-16T07:16:58.012ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23432024-08-16T07:16:58.012ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23442024-08-16T07:16:58.014ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23452024-08-16T07:16:58.014ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23462024-08-16T07:16:58.016ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23472024-08-16T07:16:58.016ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23482024-08-16T07:16:58.017ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/system/silos/recovery/quotas
23492024-08-16T07:16:58.018ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
23502024-08-16T07:16:58.018ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
23512024-08-16T07:16:58.018ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
23522024-08-16T07:16:58.021ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 36532 local_addr = 172.30.2.6:443 method = PUT remote_addr = 10.151.2.100:40839 req_id = 10135b29-138b-4c6c-8b4b-6d8326db4f1e response_code = 200 uri = /v1/system/silos/recovery/quotas
23532024-08-16T07:16:58.024ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23542024-08-16T07:16:58.024ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23552024-08-16T07:16:58.025ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23562024-08-16T07:16:58.025ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23572024-08-16T07:16:58.026ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23582024-08-16T07:16:58.027ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("token = \\"cedc205641a616d175e525d1133fce46875713d9\\"") } result = Ok(())
23592024-08-16T07:16:58.027ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23602024-08-16T07:16:58.027ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23612024-08-16T07:16:58.028ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23622024-08-16T07:16:58.028ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23632024-08-16T07:16:58.029ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23642024-08-16T07:16:58.029ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23652024-08-16T07:16:58.030ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23662024-08-16T07:16:58.030ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23672024-08-16T07:16:58.030ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23682024-08-16T07:16:58.032ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
23692024-08-16T07:16:58.032ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23702024-08-16T07:16:58.032ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23712024-08-16T07:16:58.032ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23722024-08-16T07:16:58.033ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("cedc205641a616d175e525d1133fce46875713d9") } result = Ok(())
23732024-08-16T07:16:58.033ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23742024-08-16T07:16:58.034ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23752024-08-16T07:16:58.037ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23762024-08-16T07:16:58.037ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23772024-08-16T07:16:58.038ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23782024-08-16T07:16:58.038ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23792024-08-16T07:16:58.039ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23802024-08-16T07:16:58.039ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23812024-08-16T07:16:58.040ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23822024-08-16T07:16:58.040ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23832024-08-16T07:16:58.041ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23842024-08-16T07:16:58.042ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
23852024-08-16T07:16:58.042ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23862024-08-16T07:16:58.042ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23872024-08-16T07:16:58.043ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23882024-08-16T07:16:58.043ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23892024-08-16T07:16:58.044ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
23902024-08-16T07:16:58.044ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
23912024-08-16T07:16:58.045ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
23922024-08-16T07:16:58.046ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(())
23932024-08-16T07:16:58.046ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = d70430a0-08af-4aca-8e61-895115b86f75 roles = RoleSet { roles: {} } uri = /v1/projects
23942024-08-16T07:16:58.046ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = d70430a0-08af-4aca-8e61-895115b86f75 resource = Database result = Ok(()) uri = /v1/projects
23952024-08-16T07:16:58.047ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = d70430a0-08af-4aca-8e61-895115b86f75 roles = RoleSet { roles: {} } uri = /v1/projects
23962024-08-16T07:16:58.048ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = d70430a0-08af-4aca-8e61-895115b86f75 resource = Database result = Ok(()) uri = /v1/projects
23972024-08-16T07:16:58.049ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = d70430a0-08af-4aca-8e61-895115b86f75 roles = RoleSet { roles: {} } uri = /v1/projects
23982024-08-16T07:16:58.049ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = d70430a0-08af-4aca-8e61-895115b86f75 resource = Database result = Ok(()) uri = /v1/projects
23992024-08-16T07:16:58.050ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = d70430a0-08af-4aca-8e61-895115b86f75 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/projects
24002024-08-16T07:16:58.052ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = d70430a0-08af-4aca-8e61-895115b86f75 resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(()) uri = /v1/projects
24012024-08-16T07:16:58.052ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create
24022024-08-16T07:16:58.052ZINFOnexus (SEC): saga create dag = {"end_node":17,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[2,3,null],[14,15,null],[16,0,null],[15,17,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","lookup_type":{"ById":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"},"parent":null},"project_create":{"description":"","name":"proj-cee044e5e40"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","silo_user_id":"f47a9020-f4b2-41e8-804f-a104adfa3a8c"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"project-create","start_node":16} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24032024-08-16T07:16:58.052ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create
24042024-08-16T07:16:58.085ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create
24052024-08-16T07:16:58.085ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24062024-08-16T07:16:58.085ZDEBGnexus (SEC): saga log event new_state = N016 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24072024-08-16T07:16:58.085ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24082024-08-16T07:16:58.088ZDEBGnexus (SEC): saga log event new_state = N016 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24092024-08-16T07:16:58.088ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24102024-08-16T07:16:58.092ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24112024-08-16T07:16:58.092ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24122024-08-16T07:16:58.103ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = ProjectCreateRecord
24132024-08-16T07:16:58.103ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = ProjectCreateRecord
24142024-08-16T07:16:58.105ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = ProjectCreateRecord
24152024-08-16T07:16:58.105ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = ProjectCreateRecord
24162024-08-16T07:16:58.107ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = ProjectCreateRecord
24172024-08-16T07:16:58.107ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = ProjectCreateRecord
24182024-08-16T07:16:58.108ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = ProjectCreateRecord
24192024-08-16T07:16:58.109ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = ProjectCreateRecord
24202024-08-16T07:16:58.109ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = ProjectCreateRecord
24212024-08-16T07:16:58.109ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = ProjectCreateRecord
24222024-08-16T07:16:58.117ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24232024-08-16T07:16:58.117ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "name": String("proj-cee044e5e40"), "time_created": String("2024-08-16T07:16:58.103389Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.103389Z")}, "rcgen": Number(1), "silo_id": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}]) node_id = 0 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24242024-08-16T07:16:58.120ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24252024-08-16T07:16:58.120ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24262024-08-16T07:16:58.124ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24272024-08-16T07:16:58.124ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "silo_user_id": String("f47a9020-f4b2-41e8-804f-a104adfa3a8c")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd10:c0b6:5e58::/48"), "name": String("default")}}) node_id = 1 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24282024-08-16T07:16:58.128ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24292024-08-16T07:16:58.128ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24302024-08-16T07:16:58.130ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24312024-08-16T07:16:58.130ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24322024-08-16T07:16:58.133ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24332024-08-16T07:16:58.133ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24342024-08-16T07:16:58.137ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24352024-08-16T07:16:58.137ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")) node_id = 3 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24362024-08-16T07:16:58.140ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24372024-08-16T07:16:58.140ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24382024-08-16T07:16:58.142ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24392024-08-16T07:16:58.142ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a3f966a5-6bcb-4c1c-890d-338d03f899cb")) node_id = 4 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24402024-08-16T07:16:58.145ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24412024-08-16T07:16:58.145ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24422024-08-16T07:16:58.148ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24432024-08-16T07:16:58.148ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("6c1031bd-04a4-4add-905e-bd6f1c668fb4")) node_id = 5 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24442024-08-16T07:16:58.150ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24452024-08-16T07:16:58.150ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24462024-08-16T07:16:58.153ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24472024-08-16T07:16:58.153ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("74f26508-cfab-4456-9ba7-2f56b6fb0a79")) node_id = 6 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24482024-08-16T07:16:58.156ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24492024-08-16T07:16:58.156ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24502024-08-16T07:16:58.158ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24512024-08-16T07:16:58.158ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("9868a7bf-e261-41f0-935b-55a42c54d0b6")) node_id = 7 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24522024-08-16T07:16:58.161ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24532024-08-16T07:16:58.161ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24542024-08-16T07:16:58.166ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateVpc
24552024-08-16T07:16:58.166ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateVpc
24562024-08-16T07:16:58.168ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateVpc
24572024-08-16T07:16:58.168ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateVpc
24582024-08-16T07:16:58.169ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateVpc
24592024-08-16T07:16:58.170ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateVpc
24602024-08-16T07:16:58.171ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateVpc
24612024-08-16T07:16:58.171ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateVpc
24622024-08-16T07:16:58.172ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateVpc
24632024-08-16T07:16:58.175ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") } result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateVpc
24642024-08-16T07:16:58.175ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateVpc
24652024-08-16T07:16:58.175ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateVpc
24662024-08-16T07:16:58.182ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24672024-08-16T07:16:58.182ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412"), "name": String("default"), "time_created": String("2024-08-16T07:16:58.166590Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.166590Z")}, "ipv6_prefix": String("fd10:c0b6:5e58::/48"), "project_id": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "subnet_gen": Number(1), "system_router_id": String("a3f966a5-6bcb-4c1c-890d-338d03f899cb"), "vni": Number(2415607)}]) node_id = 8 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24682024-08-16T07:16:58.185ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24692024-08-16T07:16:58.185ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24702024-08-16T07:16:58.187ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateRouter
24712024-08-16T07:16:58.187ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateRouter
24722024-08-16T07:16:58.189ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateRouter
24732024-08-16T07:16:58.189ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateRouter
24742024-08-16T07:16:58.190ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateRouter
24752024-08-16T07:16:58.190ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateRouter
24762024-08-16T07:16:58.192ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateRouter
24772024-08-16T07:16:58.192ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateRouter
24782024-08-16T07:16:58.193ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateRouter
24792024-08-16T07:16:58.196ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") } result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateRouter
24802024-08-16T07:16:58.196ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateRouter
24812024-08-16T07:16:58.196ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateRouter
24822024-08-16T07:16:58.222ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24832024-08-16T07:16:58.222ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("a3f966a5-6bcb-4c1c-890d-338d03f899cb"), "lookup_type": Object {"ById": String("a3f966a5-6bcb-4c1c-890d-338d03f899cb")}, "parent": Object {"key": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}}}) node_id = 9 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24842024-08-16T07:16:58.225ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24852024-08-16T07:16:58.225ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
24862024-08-16T07:16:58.228ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV4Route
24872024-08-16T07:16:58.228ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV4Route
24882024-08-16T07:16:58.230ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV4Route
24892024-08-16T07:16:58.230ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV4Route
24902024-08-16T07:16:58.231ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV4Route
24912024-08-16T07:16:58.231ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV4Route
24922024-08-16T07:16:58.233ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV4Route
24932024-08-16T07:16:58.233ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV4Route
24942024-08-16T07:16:58.234ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV4Route
24952024-08-16T07:16:58.237ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") }, key: a3f966a5-6bcb-4c1c-890d-338d03f899cb, lookup_type: ById(a3f966a5-6bcb-4c1c-890d-338d03f899cb) } result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV4Route
24962024-08-16T07:16:58.237ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV4Route
24972024-08-16T07:16:58.237ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV4Route
24982024-08-16T07:16:58.272ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
24992024-08-16T07:16:58.272ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25002024-08-16T07:16:58.276ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25012024-08-16T07:16:58.276ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25022024-08-16T07:16:58.281ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV6Route
25032024-08-16T07:16:58.281ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV6Route
25042024-08-16T07:16:58.282ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV6Route
25052024-08-16T07:16:58.283ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV6Route
25062024-08-16T07:16:58.284ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV6Route
25072024-08-16T07:16:58.284ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV6Route
25082024-08-16T07:16:58.286ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV6Route
25092024-08-16T07:16:58.286ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV6Route
25102024-08-16T07:16:58.288ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV6Route
25112024-08-16T07:16:58.290ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") }, key: a3f966a5-6bcb-4c1c-890d-338d03f899cb, lookup_type: ById(a3f966a5-6bcb-4c1c-890d-338d03f899cb) } result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV6Route
25122024-08-16T07:16:58.290ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV6Route
25132024-08-16T07:16:58.290ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateV6Route
25142024-08-16T07:16:58.319ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25152024-08-16T07:16:58.319ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25162024-08-16T07:16:58.323ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25172024-08-16T07:16:58.323ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25182024-08-16T07:16:58.326ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25192024-08-16T07:16:58.326ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25202024-08-16T07:16:58.327ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25212024-08-16T07:16:58.327ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25222024-08-16T07:16:58.329ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25232024-08-16T07:16:58.329ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25242024-08-16T07:16:58.331ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25252024-08-16T07:16:58.331ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25262024-08-16T07:16:58.332ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25272024-08-16T07:16:58.335ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") } result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25282024-08-16T07:16:58.340ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25292024-08-16T07:16:58.340ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25302024-08-16T07:16:58.352ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25312024-08-16T07:16:58.353ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcCreateSubnet
25322024-08-16T07:16:58.356ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25332024-08-16T07:16:58.356ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("9868a7bf-e261-41f0-935b-55a42c54d0b6"), "lookup_type": Object {"ById": String("9868a7bf-e261-41f0-935b-55a42c54d0b6")}, "parent": Object {"key": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("9868a7bf-e261-41f0-935b-55a42c54d0b6"), "name": String("default"), "time_created": String("2024-08-16T07:16:58.325978Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.325978Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd10:c0b6:5e58::/64"), "rcgen": Number(1), "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")}]) node_id = 12 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25342024-08-16T07:16:58.359ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25352024-08-16T07:16:58.359ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25362024-08-16T07:16:58.362ZDEBGnexus: default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 91b02407-ac97-41ee-8190-3c86a49b1ca0, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2024-08-16T07:16:58.362241745Z, time_modified: 2024-08-16T07:16:58.362241745Z, time_deleted: None }, vpc_id: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 79118bd7-c222-4cf3-aa84-0962cbdd5959, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2024-08-16T07:16:58.362248845Z, time_modified: 2024-08-16T07:16:58.362248845Z, time_deleted: None }, vpc_id: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: af4e1e0a-3e01-46b4-9733-115736687ce1, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2024-08-16T07:16:58.362810278Z, time_modified: 2024-08-16T07:16:58.362810278Z, time_deleted: None }, vpc_id: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
25372024-08-16T07:16:58.362ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcUpdateFirewall
25382024-08-16T07:16:58.363ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcUpdateFirewall
25392024-08-16T07:16:58.364ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcUpdateFirewall
25402024-08-16T07:16:58.364ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcUpdateFirewall
25412024-08-16T07:16:58.366ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcUpdateFirewall
25422024-08-16T07:16:58.366ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcUpdateFirewall
25432024-08-16T07:16:58.367ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcUpdateFirewall
25442024-08-16T07:16:58.367ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcUpdateFirewall
25452024-08-16T07:16:58.369ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcUpdateFirewall
25462024-08-16T07:16:58.372ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") } result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcUpdateFirewall
25472024-08-16T07:16:58.372ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcUpdateFirewall
25482024-08-16T07:16:58.372ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcUpdateFirewall
25492024-08-16T07:16:58.417ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25502024-08-16T07:16:58.417ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("91b02407-ac97-41ee-8190-3c86a49b1ca0"), "name": String("allow-internal-inbound"), "time_created": String("2024-08-16T07:16:58.362241745Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.362241745Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("79118bd7-c222-4cf3-aa84-0962cbdd5959"), "name": String("allow-ssh"), "time_created": String("2024-08-16T07:16:58.362248845Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.362248845Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("af4e1e0a-3e01-46b4-9733-115736687ce1"), "name": String("allow-icmp"), "time_created": String("2024-08-16T07:16:58.362810278Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.362810278Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")}]) node_id = 13 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25512024-08-16T07:16:58.421ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25522024-08-16T07:16:58.421ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25532024-08-16T07:16:58.428ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25542024-08-16T07:16:58.428ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25552024-08-16T07:16:58.429ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25562024-08-16T07:16:58.429ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25572024-08-16T07:16:58.430ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25582024-08-16T07:16:58.430ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25592024-08-16T07:16:58.431ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25602024-08-16T07:16:58.431ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25612024-08-16T07:16:58.432ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25622024-08-16T07:16:58.432ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25632024-08-16T07:16:58.434ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25642024-08-16T07:16:58.434ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25652024-08-16T07:16:58.435ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25662024-08-16T07:16:58.436ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25672024-08-16T07:16:58.437ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25682024-08-16T07:16:58.440ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ById(45d6a56f-b234-479b-88df-52ddb7b4272c) }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") } result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25692024-08-16T07:16:58.440ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25702024-08-16T07:16:58.440ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25712024-08-16T07:16:58.441ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25722024-08-16T07:16:58.441ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25732024-08-16T07:16:58.443ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25742024-08-16T07:16:58.443ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25752024-08-16T07:16:58.444ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25762024-08-16T07:16:58.444ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25772024-08-16T07:16:58.446ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25782024-08-16T07:16:58.448ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ById(45d6a56f-b234-479b-88df-52ddb7b4272c) }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") } result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25792024-08-16T07:16:58.448ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25802024-08-16T07:16:58.449ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_node = VpcNotifySleds
25812024-08-16T07:16:58.452ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
25822024-08-16T07:16:58.452ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = []
25832024-08-16T07:16:58.452ZDEBGnexus: resolved 0 rules for sleds
25842024-08-16T07:16:58.501ZDEBGnexus: resolved sleds for vpc default vpc_to_sled = []
25852024-08-16T07:16:58.501ZDEBGnexus: sending firewall rules to sled agents
25862024-08-16T07:16:58.501ZINFOnexus: updated firewall rules on 0 sleds file = nexus/networking/src/firewall_rules.rs:496
25872024-08-16T07:16:58.501ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25882024-08-16T07:16:58.501ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25892024-08-16T07:16:58.503ZDEBGnexus (SEC): saga log event new_state = N015 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25902024-08-16T07:16:58.503ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25912024-08-16T07:16:58.506ZDEBGnexus (SEC): saga log event new_state = N015 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25922024-08-16T07:16:58.506ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 15 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25932024-08-16T07:16:58.508ZDEBGnexus (SEC): saga log event new_state = N017 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25942024-08-16T07:16:58.508ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25952024-08-16T07:16:58.512ZDEBGnexus (SEC): saga log event new_state = N017 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25962024-08-16T07:16:58.512ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25972024-08-16T07:16:58.515ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 7f09fccf-b27b-4162-852c-972953200e76 sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
25982024-08-16T07:16:58.515ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 7f09fccf-b27b-4162-852c-972953200e76
25992024-08-16T07:16:58.547ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
26002024-08-16T07:16:58.548ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 7f09fccf-b27b-4162-852c-972953200e76 saga_name = project-create saga_result = SagaResult { saga_id: 7f09fccf-b27b-4162-852c-972953200e76, saga_log: SagaLog { saga_id: 7f09fccf-b27b-4162-852c-972953200e76, unwinding: false, events: [N016 started, N016 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N017 started, N017 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "name": String("proj-cee044e5e40"), "time_created": String("2024-08-16T07:16:58.103389Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.103389Z")}, "rcgen": Number(1), "silo_id": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "silo_user_id": String("f47a9020-f4b2-41e8-804f-a104adfa3a8c")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd10:c0b6:5e58::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")), 4: Succeeded(String("a3f966a5-6bcb-4c1c-890d-338d03f899cb")), 5: Succeeded(String("6c1031bd-04a4-4add-905e-bd6f1c668fb4")), 6: Succeeded(String("74f26508-cfab-4456-9ba7-2f56b6fb0a79")), 7: Succeeded(String("9868a7bf-e261-41f0-935b-55a42c54d0b6")), 8: Succeeded(Array [Object {"key": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412"), "name": String("default"), "time_created": String("2024-08-16T07:16:58.166590Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.166590Z")}, "ipv6_prefix": String("fd10:c0b6:5e58::/48"), "project_id": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "subnet_gen": Number(1), "system_router_id": String("a3f966a5-6bcb-4c1c-890d-338d03f899cb"), "vni": Number(2415607)}]), 9: Succeeded(Object {"key": String("a3f966a5-6bcb-4c1c-890d-338d03f899cb"), "lookup_type": Object {"ById": String("a3f966a5-6bcb-4c1c-890d-338d03f899cb")}, "parent": Object {"key": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}}}), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Array [Object {"key": String("9868a7bf-e261-41f0-935b-55a42c54d0b6"), "lookup_type": Object {"ById": String("9868a7bf-e261-41f0-935b-55a42c54d0b6")}, "parent": Object {"key": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("9868a7bf-e261-41f0-935b-55a42c54d0b6"), "name": String("default"), "time_created": String("2024-08-16T07:16:58.325978Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.325978Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd10:c0b6:5e58::/64"), "rcgen": Number(1), "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")}]), 13: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("91b02407-ac97-41ee-8190-3c86a49b1ca0"), "name": String("allow-internal-inbound"), "time_created": String("2024-08-16T07:16:58.362241745Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.362241745Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("79118bd7-c222-4cf3-aa84-0962cbdd5959"), "name": String("allow-ssh"), "time_created": String("2024-08-16T07:16:58.362248845Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.362248845Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("af4e1e0a-3e01-46b4-9733-115736687ce1"), "name": String("allow-icmp"), "time_created": String("2024-08-16T07:16:58.362810278Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.362810278Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")}]), 14: Succeeded(Null), 15: Succeeded(Null), 16: Succeeded(Null), 17: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_subnet_id": String("9868a7bf-e261-41f0-935b-55a42c54d0b6"), "default_v4_route_id": String("6c1031bd-04a4-4add-905e-bd6f1c668fb4"), "default_v6_route_id": String("74f26508-cfab-4456-9ba7-2f56b6fb0a79"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("91b02407-ac97-41ee-8190-3c86a49b1ca0"), "name": String("allow-internal-inbound"), "time_created": String("2024-08-16T07:16:58.362241745Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.362241745Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("79118bd7-c222-4cf3-aa84-0962cbdd5959"), "name": String("allow-ssh"), "time_created": String("2024-08-16T07:16:58.362248845Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.362248845Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("af4e1e0a-3e01-46b4-9733-115736687ce1"), "name": String("allow-icmp"), "time_created": String("2024-08-16T07:16:58.362810278Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.362810278Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")}], "no_result": Null, "project": Array [Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "name": String("proj-cee044e5e40"), "time_created": String("2024-08-16T07:16:58.103389Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.103389Z")}, "rcgen": Number(1), "silo_id": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}], "route4": Null, "route6": Null, "router": Object {"key": String("a3f966a5-6bcb-4c1c-890d-338d03f899cb"), "lookup_type": Object {"ById": String("a3f966a5-6bcb-4c1c-890d-338d03f899cb")}, "parent": Object {"key": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("9868a7bf-e261-41f0-935b-55a42c54d0b6"), "lookup_type": Object {"ById": String("9868a7bf-e261-41f0-935b-55a42c54d0b6")}, "parent": Object {"key": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("9868a7bf-e261-41f0-935b-55a42c54d0b6"), "name": String("default"), "time_created": String("2024-08-16T07:16:58.325978Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.325978Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd10:c0b6:5e58::/64"), "rcgen": Number(1), "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")}], "system_router_id": String("a3f966a5-6bcb-4c1c-890d-338d03f899cb"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "lookup_type": Object {"ByName": String("proj-cee044e5e40")}, "parent": Object {"key": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "lookup_type": Object {"ById": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "silo_user_id": String("f47a9020-f4b2-41e8-804f-a104adfa3a8c")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd10:c0b6:5e58::/48"), "name": String("default")}}, "vpc_id": String("e2f53b90-6ef1-4b4b-83c5-c26a39e60412")} }) }
26012024-08-16T07:16:58.548ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 525523 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = d70430a0-08af-4aca-8e61-895115b86f75 response_code = 201 uri = /v1/projects
26022024-08-16T07:16:58.551ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26032024-08-16T07:16:58.552ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26042024-08-16T07:16:58.553ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26052024-08-16T07:16:58.553ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26062024-08-16T07:16:58.554ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26072024-08-16T07:16:58.555ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("token = \\"cedc205641a616d175e525d1133fce46875713d9\\"") } result = Ok(())
26082024-08-16T07:16:58.555ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26092024-08-16T07:16:58.555ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26102024-08-16T07:16:58.556ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26112024-08-16T07:16:58.556ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26122024-08-16T07:16:58.557ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26132024-08-16T07:16:58.557ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26142024-08-16T07:16:58.557ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26152024-08-16T07:16:58.558ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26162024-08-16T07:16:58.558ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26172024-08-16T07:16:58.559ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
26182024-08-16T07:16:58.560ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26192024-08-16T07:16:58.560ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26202024-08-16T07:16:58.561ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26212024-08-16T07:16:58.562ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("cedc205641a616d175e525d1133fce46875713d9") } result = Ok(())
26222024-08-16T07:16:58.562ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26232024-08-16T07:16:58.562ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26242024-08-16T07:16:58.564ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26252024-08-16T07:16:58.564ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26262024-08-16T07:16:58.565ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26272024-08-16T07:16:58.565ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26282024-08-16T07:16:58.566ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26292024-08-16T07:16:58.567ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26302024-08-16T07:16:58.567ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26312024-08-16T07:16:58.567ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26322024-08-16T07:16:58.568ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26332024-08-16T07:16:58.569ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
26342024-08-16T07:16:58.569ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26352024-08-16T07:16:58.570ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26362024-08-16T07:16:58.571ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26372024-08-16T07:16:58.571ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26382024-08-16T07:16:58.572ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26392024-08-16T07:16:58.572ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26402024-08-16T07:16:58.572ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26412024-08-16T07:16:58.573ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(())
26422024-08-16T07:16:58.573ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-cee044e5e40
26432024-08-16T07:16:58.574ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df resource = Database result = Ok(()) uri = /v1/disks?project=proj-cee044e5e40
26442024-08-16T07:16:58.574ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-cee044e5e40
26452024-08-16T07:16:58.575ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df resource = Database result = Ok(()) uri = /v1/disks?project=proj-cee044e5e40
26462024-08-16T07:16:58.576ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-cee044e5e40
26472024-08-16T07:16:58.576ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df resource = Database result = Ok(()) uri = /v1/disks?project=proj-cee044e5e40
26482024-08-16T07:16:58.577ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-cee044e5e40
26492024-08-16T07:16:58.578ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df resource = Database result = Ok(()) uri = /v1/disks?project=proj-cee044e5e40
26502024-08-16T07:16:58.579ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-cee044e5e40
26512024-08-16T07:16:58.579ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df resource = Database result = Ok(()) uri = /v1/disks?project=proj-cee044e5e40
26522024-08-16T07:16:58.581ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-cee044e5e40
26532024-08-16T07:16:58.581ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df resource = Database result = Ok(()) uri = /v1/disks?project=proj-cee044e5e40
26542024-08-16T07:16:58.582ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/disks?project=proj-cee044e5e40
26552024-08-16T07:16:58.584ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df resource = Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") } result = Ok(()) uri = /v1/disks?project=proj-cee044e5e40
26562024-08-16T07:16:58.584ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create
26572024-08-16T07:16:58.584ZINFOnexus (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.create_disk_record","label":"CreateDiskRecord","name":"created_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"disk_runtime"}},{"Start":{"params":{"create_params":{"description":"","disk_source":{"block_size":512,"type":"blank"},"name":"disk-4563d514fe8","size":1073741824},"project_id":"45d6a56f-b234-479b-88df-52ddb7b4272c","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","silo_user_id":"f47a9020-f4b2-41e8-804f-a104adfa3a8c"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
26582024-08-16T07:16:58.584ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create
26592024-08-16T07:16:58.596ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
26602024-08-16T07:16:58.596ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:45115
26612024-08-16T07:16:58.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:45115 req_id = d8f3cf3f-048f-4627-82fe-499d24394162 roles = RoleSet { roles: {} } uri = /metrics/producers
26622024-08-16T07:16:58.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:45115 req_id = d8f3cf3f-048f-4627-82fe-499d24394162 resource = Database result = Ok(()) uri = /metrics/producers
26632024-08-16T07:16:58.597ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:902 latency_us = 1365 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:45115 req_id = d8f3cf3f-048f-4627-82fe-499d24394162 response_code = 503 uri = /metrics/producers
26642024-08-16T07:16:58.597ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 503, headers: {"content-type": "application/json", "x-request-id": "d8f3cf3f-048f-4627-82fe-499d24394162", "content-length": "133", "date": "Fri, 16 Aug 2024 07:16:58 GMT"} })
26652024-08-16T07:16:58.598ZWARNnexus (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.007125267s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"d8f3cf3f-048f-4627-82fe-499d24394162\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Fri, 16 Aug 2024 07:16:58 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"d8f3cf3f-048f-4627-82fe-499d24394162\\" }" file = oximeter/producer/src/lib.rs:424
26662024-08-16T07:16:58.610ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create
26672024-08-16T07:16:58.610ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
26682024-08-16T07:16:58.610ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
26692024-08-16T07:16:58.610ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
26702024-08-16T07:16:58.612ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
26712024-08-16T07:16:58.612ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
26722024-08-16T07:16:58.615ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
26732024-08-16T07:16:58.615ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
26742024-08-16T07:16:58.618ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
26752024-08-16T07:16:58.618ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d3fb5a5c-10ff-44c5-832d-454a4e847820")) node_id = 0 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
26762024-08-16T07:16:58.621ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
26772024-08-16T07:16:58.621ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
26782024-08-16T07:16:58.625ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
26792024-08-16T07:16:58.625ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")) node_id = 1 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
26802024-08-16T07:16:58.627ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
26812024-08-16T07:16:58.627ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
26822024-08-16T07:16:58.630ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26832024-08-16T07:16:58.630ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26842024-08-16T07:16:58.631ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26852024-08-16T07:16:58.631ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26862024-08-16T07:16:58.632ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26872024-08-16T07:16:58.632ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26882024-08-16T07:16:58.633ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26892024-08-16T07:16:58.633ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26902024-08-16T07:16:58.635ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26912024-08-16T07:16:58.635ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26922024-08-16T07:16:58.637ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26932024-08-16T07:16:58.637ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26942024-08-16T07:16:58.638ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26952024-08-16T07:16:58.640ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ById(45d6a56f-b234-479b-88df-52ddb7b4272c) } result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26962024-08-16T07:16:58.640ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26972024-08-16T07:16:58.640ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26982024-08-16T07:16:58.642ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
26992024-08-16T07:16:58.642ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
27002024-08-16T07:16:58.643ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
27012024-08-16T07:16:58.644ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
27022024-08-16T07:16:58.645ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
27032024-08-16T07:16:58.645ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
27042024-08-16T07:16:58.647ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
27052024-08-16T07:16:58.649ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ById(45d6a56f-b234-479b-88df-52ddb7b4272c) } result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
27062024-08-16T07:16:58.649ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
27072024-08-16T07:16:58.649ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = CreateDiskRecord
27082024-08-16T07:16:58.686ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27092024-08-16T07:16:58.686ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d3fb5a5c-10ff-44c5-832d-454a4e847820"), "name": String("disk-4563d514fe8"), "time_created": String("2024-08-16T07:16:58.630100Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.630100Z")}, "pantry_address": Null, "project_id": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-08-16T07:16:58.630100Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}) node_id = 2 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27102024-08-16T07:16:58.689ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27112024-08-16T07:16:58.689ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27122024-08-16T07:16:58.693ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = RegionsAlloc
27132024-08-16T07:16:58.693ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = RegionsAlloc
27142024-08-16T07:16:58.728ZINFOnexus (datastore): Allocated regions for volume datasets_and_regions = [(Dataset { identity: DatasetIdentity { id: ac3575fe-e30b-4ddb-b942-e1a3a0a89ea9, time_created: 2024-08-16T07:16:55.302310Z, time_modified: 2024-08-16T07:16:55.302310Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 32dc67d8-c3d1-40d3-a330-91e503ec31dd, ip: Some(fd00:1122:3344:101::12), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824) }, Region { identity: RegionIdentity { id: 124a1644-8d10-4218-959f-2b9a64fe0b64, time_created: 2024-08-16T07:16:58.705551Z, time_modified: 2024-08-16T07:16:58.705551Z }, dataset_id: ac3575fe-e30b-4ddb-b942-e1a3a0a89ea9, volume_id: a8a230f2-6101-4e8d-94e6-5795d60cec7f, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false }), (Dataset { identity: DatasetIdentity { id: fa8b85ab-80e3-4e8f-bdde-3ec4ddd4be58, time_created: 2024-08-16T07:16:55.302310Z, time_modified: 2024-08-16T07:16:55.302310Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: c37936e1-d2ff-4b96-ae25-825fa65e7f45, ip: Some(fd00:1122:3344:101::14), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824) }, Region { identity: RegionIdentity { id: 874b590c-69ba-41c9-8c19-99ce0ddb1ac8, time_created: 2024-08-16T07:16:58.705551Z, time_modified: 2024-08-16T07:16:58.705551Z }, dataset_id: fa8b85ab-80e3-4e8f-bdde-3ec4ddd4be58, volume_id: a8a230f2-6101-4e8d-94e6-5795d60cec7f, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false }), (Dataset { identity: DatasetIdentity { id: 070ea44c-c791-445e-a89f-ccaabae9c99f, time_created: 2024-08-16T07:16:55.302311Z, time_modified: 2024-08-16T07:16:55.302311Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 5ef50a5e-8b9b-49d0-b9a2-1cf69e3ae6c4, ip: Some(fd00:1122:3344:101::1a), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824) }, Region { identity: RegionIdentity { id: 82d51a95-d2df-4b6c-8855-0dbfd639af8e, time_created: 2024-08-16T07:16:58.705551Z, time_modified: 2024-08-16T07:16:58.705551Z }, dataset_id: 070ea44c-c791-445e-a89f-ccaabae9c99f, volume_id: a8a230f2-6101-4e8d-94e6-5795d60cec7f, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false })] file = nexus/db-queries/src/db/datastore/region.rs:280 maybe_snapshot_id = None volume_id = a8a230f2-6101-4e8d-94e6-5795d60cec7f
27152024-08-16T07:16:58.728ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27162024-08-16T07:16:58.728ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"identity": Object {"id": String("ac3575fe-e30b-4ddb-b942-e1a3a0a89ea9"), "time_created": String("2024-08-16T07:16:55.302310Z"), "time_modified": String("2024-08-16T07:16:55.302310Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("32dc67d8-c3d1-40d3-a330-91e503ec31dd"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("ac3575fe-e30b-4ddb-b942-e1a3a0a89ea9"), "extent_count": Number(16), "identity": Object {"id": String("124a1644-8d10-4218-959f-2b9a64fe0b64"), "time_created": String("2024-08-16T07:16:58.705551Z"), "time_modified": String("2024-08-16T07:16:58.705551Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}], Array [Object {"identity": Object {"id": String("fa8b85ab-80e3-4e8f-bdde-3ec4ddd4be58"), "time_created": String("2024-08-16T07:16:55.302310Z"), "time_modified": String("2024-08-16T07:16:55.302310Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("c37936e1-d2ff-4b96-ae25-825fa65e7f45"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("fa8b85ab-80e3-4e8f-bdde-3ec4ddd4be58"), "extent_count": Number(16), "identity": Object {"id": String("874b590c-69ba-41c9-8c19-99ce0ddb1ac8"), "time_created": String("2024-08-16T07:16:58.705551Z"), "time_modified": String("2024-08-16T07:16:58.705551Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}], Array [Object {"identity": Object {"id": String("070ea44c-c791-445e-a89f-ccaabae9c99f"), "time_created": String("2024-08-16T07:16:55.302311Z"), "time_modified": String("2024-08-16T07:16:55.302311Z")}, "ip": String("fd00:1122:3344:101::1a"), "kind": String("Crucible"), "pool_id": String("5ef50a5e-8b9b-49d0-b9a2-1cf69e3ae6c4"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("070ea44c-c791-445e-a89f-ccaabae9c99f"), "extent_count": Number(16), "identity": Object {"id": String("82d51a95-d2df-4b6c-8855-0dbfd639af8e"), "time_created": String("2024-08-16T07:16:58.705551Z"), "time_modified": String("2024-08-16T07:16:58.705551Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}]]) node_id = 3 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27172024-08-16T07:16:58.731ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27182024-08-16T07:16:58.731ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27192024-08-16T07:16:58.734ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = SpaceAccount
27202024-08-16T07:16:58.735ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = SpaceAccount
27212024-08-16T07:16:58.747ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27222024-08-16T07:16:58.747ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27232024-08-16T07:16:58.750ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27242024-08-16T07:16:58.750ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27252024-08-16T07:16:58.753ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27262024-08-16T07:16:58.753ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27272024-08-16T07:16:58.755ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27282024-08-16T07:16:58.755ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27292024-08-16T07:16:58.765ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 259.481583ms dataset = ac3575fe-e30b-4ddb-b942-e1a3a0a89ea9 file = nexus/src/app/crucible.rs:230 region = 124a1644-8d10-4218-959f-2b9a64fe0b64 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create
27302024-08-16T07:16:58.765ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 310.649187ms dataset = 070ea44c-c791-445e-a89f-ccaabae9c99f file = nexus/src/app/crucible.rs:230 region = 82d51a95-d2df-4b6c-8855-0dbfd639af8e saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create
27312024-08-16T07:16:58.766ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 136.996277ms dataset = fa8b85ab-80e3-4e8f-bdde-3ec4ddd4be58 file = nexus/src/app/crucible.rs:230 region = 874b590c-69ba-41c9-8c19-99ce0ddb1ac8 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create
27322024-08-16T07:16:58.908ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 443.078791ms dataset = fa8b85ab-80e3-4e8f-bdde-3ec4ddd4be58 file = nexus/src/app/crucible.rs:230 region = 874b590c-69ba-41c9-8c19-99ce0ddb1ac8 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create
27332024-08-16T07:16:59.363ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27342024-08-16T07:16:59.363ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"d3fb5a5c-10ff-44c5-832d-454a4e847820\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"d3fb5a5c-10ff-44c5-832d-454a4e847820\\",\\"key\\":\\"uVxiUvWS+AqcYeeIcMPhmijW0c8bmhhDpP41efWqpDU=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::12]:19000\\",\\"[fd00:1122:3344:101::1a]:19000\\",\\"[fd00:1122:3344:101::14]:19000\\"]}}]}")) node_id = 6 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27352024-08-16T07:16:59.366ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27362024-08-16T07:16:59.366ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27372024-08-16T07:16:59.375ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27382024-08-16T07:16:59.375ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27392024-08-16T07:16:59.378ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27402024-08-16T07:16:59.378ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27412024-08-16T07:16:59.381ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27422024-08-16T07:16:59.381ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27432024-08-16T07:16:59.383ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27442024-08-16T07:16:59.383ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27452024-08-16T07:16:59.384ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27462024-08-16T07:16:59.385ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27472024-08-16T07:16:59.386ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27482024-08-16T07:16:59.386ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27492024-08-16T07:16:59.388ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27502024-08-16T07:16:59.388ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27512024-08-16T07:16:59.389ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27522024-08-16T07:16:59.390ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27532024-08-16T07:16:59.391ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27542024-08-16T07:16:59.392ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27552024-08-16T07:16:59.393ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27562024-08-16T07:16:59.396ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ById(45d6a56f-b234-479b-88df-52ddb7b4272c) }, key: d3fb5a5c-10ff-44c5-832d-454a4e847820, lookup_type: ById(d3fb5a5c-10ff-44c5-832d-454a4e847820) } result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27572024-08-16T07:16:59.396ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27582024-08-16T07:16:59.396ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27592024-08-16T07:16:59.398ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27602024-08-16T07:16:59.398ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27612024-08-16T07:16:59.400ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27622024-08-16T07:16:59.400ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27632024-08-16T07:16:59.401ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27642024-08-16T07:16:59.402ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27652024-08-16T07:16:59.403ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27662024-08-16T07:16:59.406ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ById(45d6a56f-b234-479b-88df-52ddb7b4272c) }, key: d3fb5a5c-10ff-44c5-832d-454a4e847820, lookup_type: ById(d3fb5a5c-10ff-44c5-832d-454a4e847820) } result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27672024-08-16T07:16:59.406ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27682024-08-16T07:16:59.406ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_node = FinalizeDiskRecord
27692024-08-16T07:16:59.414ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27702024-08-16T07:16:59.414ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27712024-08-16T07:16:59.417ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27722024-08-16T07:16:59.417ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27732024-08-16T07:16:59.419ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27742024-08-16T07:16:59.419ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27752024-08-16T07:16:59.422ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27762024-08-16T07:16:59.422ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763
27772024-08-16T07:16:59.429ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
27782024-08-16T07:16:59.429ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = f07ce892-45f7-41df-87ad-83b1c0ec9763 saga_name = disk-create saga_result = SagaResult { saga_id: f07ce892-45f7-41df-87ad-83b1c0ec9763, saga_log: SagaLog { saga_id: f07ce892-45f7-41df-87ad-83b1c0ec9763, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("d3fb5a5c-10ff-44c5-832d-454a4e847820")), 1: Succeeded(String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")), 2: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d3fb5a5c-10ff-44c5-832d-454a4e847820"), "name": String("disk-4563d514fe8"), "time_created": String("2024-08-16T07:16:58.630100Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.630100Z")}, "pantry_address": Null, "project_id": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-08-16T07:16:58.630100Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}), 3: Succeeded(Array [Array [Object {"identity": Object {"id": String("ac3575fe-e30b-4ddb-b942-e1a3a0a89ea9"), "time_created": String("2024-08-16T07:16:55.302310Z"), "time_modified": String("2024-08-16T07:16:55.302310Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("32dc67d8-c3d1-40d3-a330-91e503ec31dd"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("ac3575fe-e30b-4ddb-b942-e1a3a0a89ea9"), "extent_count": Number(16), "identity": Object {"id": String("124a1644-8d10-4218-959f-2b9a64fe0b64"), "time_created": String("2024-08-16T07:16:58.705551Z"), "time_modified": String("2024-08-16T07:16:58.705551Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}], Array [Object {"identity": Object {"id": String("fa8b85ab-80e3-4e8f-bdde-3ec4ddd4be58"), "time_created": String("2024-08-16T07:16:55.302310Z"), "time_modified": String("2024-08-16T07:16:55.302310Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("c37936e1-d2ff-4b96-ae25-825fa65e7f45"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("fa8b85ab-80e3-4e8f-bdde-3ec4ddd4be58"), "extent_count": Number(16), "identity": Object {"id": String("874b590c-69ba-41c9-8c19-99ce0ddb1ac8"), "time_created": String("2024-08-16T07:16:58.705551Z"), "time_modified": String("2024-08-16T07:16:58.705551Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}], Array [Object {"identity": Object {"id": String("070ea44c-c791-445e-a89f-ccaabae9c99f"), "time_created": String("2024-08-16T07:16:55.302311Z"), "time_modified": String("2024-08-16T07:16:55.302311Z")}, "ip": String("fd00:1122:3344:101::1a"), "kind": String("Crucible"), "pool_id": String("5ef50a5e-8b9b-49d0-b9a2-1cf69e3ae6c4"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("070ea44c-c791-445e-a89f-ccaabae9c99f"), "extent_count": Number(16), "identity": Object {"id": String("82d51a95-d2df-4b6c-8855-0dbfd639af8e"), "time_created": String("2024-08-16T07:16:58.705551Z"), "time_modified": String("2024-08-16T07:16:58.705551Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}]]), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"d3fb5a5c-10ff-44c5-832d-454a4e847820\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"d3fb5a5c-10ff-44c5-832d-454a4e847820\\",\\"key\\":\\"uVxiUvWS+AqcYeeIcMPhmijW0c8bmhhDpP41efWqpDU=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::12]:19000\\",\\"[fd00:1122:3344:101::1a]:19000\\",\\"[fd00:1122:3344:101::14]:19000\\"]}}]}")), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"created_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d3fb5a5c-10ff-44c5-832d-454a4e847820"), "name": String("disk-4563d514fe8"), "time_created": String("2024-08-16T07:16:58.630100Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.630100Z")}, "pantry_address": Null, "project_id": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-08-16T07:16:58.630100Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}, "created_volume": Null, "datasets_and_regions": Array [Array [Object {"identity": Object {"id": String("ac3575fe-e30b-4ddb-b942-e1a3a0a89ea9"), "time_created": String("2024-08-16T07:16:55.302310Z"), "time_modified": String("2024-08-16T07:16:55.302310Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("32dc67d8-c3d1-40d3-a330-91e503ec31dd"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("ac3575fe-e30b-4ddb-b942-e1a3a0a89ea9"), "extent_count": Number(16), "identity": Object {"id": String("124a1644-8d10-4218-959f-2b9a64fe0b64"), "time_created": String("2024-08-16T07:16:58.705551Z"), "time_modified": String("2024-08-16T07:16:58.705551Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}], Array [Object {"identity": Object {"id": String("fa8b85ab-80e3-4e8f-bdde-3ec4ddd4be58"), "time_created": String("2024-08-16T07:16:55.302310Z"), "time_modified": String("2024-08-16T07:16:55.302310Z")}, "ip": String("fd00:1122:3344:101::14"), "kind": String("Crucible"), "pool_id": String("c37936e1-d2ff-4b96-ae25-825fa65e7f45"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("fa8b85ab-80e3-4e8f-bdde-3ec4ddd4be58"), "extent_count": Number(16), "identity": Object {"id": String("874b590c-69ba-41c9-8c19-99ce0ddb1ac8"), "time_created": String("2024-08-16T07:16:58.705551Z"), "time_modified": String("2024-08-16T07:16:58.705551Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}], Array [Object {"identity": Object {"id": String("070ea44c-c791-445e-a89f-ccaabae9c99f"), "time_created": String("2024-08-16T07:16:55.302311Z"), "time_modified": String("2024-08-16T07:16:55.302311Z")}, "ip": String("fd00:1122:3344:101::1a"), "kind": String("Crucible"), "pool_id": String("5ef50a5e-8b9b-49d0-b9a2-1cf69e3ae6c4"), "port": Number(32345), "rcgen": Number(1), "size_used": Number(1073741824), "time_deleted": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("070ea44c-c791-445e-a89f-ccaabae9c99f"), "extent_count": Number(16), "identity": Object {"id": String("82d51a95-d2df-4b6c-8855-0dbfd639af8e"), "time_created": String("2024-08-16T07:16:58.705551Z"), "time_modified": String("2024-08-16T07:16:58.705551Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}]], "disk_id": String("d3fb5a5c-10ff-44c5-832d-454a4e847820"), "disk_runtime": Null, "no_result": Null, "regions_ensure": String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"d3fb5a5c-10ff-44c5-832d-454a4e847820\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"d3fb5a5c-10ff-44c5-832d-454a4e847820\\",\\"key\\":\\"uVxiUvWS+AqcYeeIcMPhmijW0c8bmhhDpP41efWqpDU=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::12]:19000\\",\\"[fd00:1122:3344:101::1a]:19000\\",\\"[fd00:1122:3344:101::14]:19000\\"]}}]}"), "regions_ensure_undo": Null, "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")} }) }
27792024-08-16T07:16:59.429ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 878689 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = da250590-a4ad-49b5-a13a-87c3930135df response_code = 201 uri = /v1/disks?project=proj-cee044e5e40
27802024-08-16T07:16:59.432ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27812024-08-16T07:16:59.432ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27822024-08-16T07:16:59.433ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27832024-08-16T07:16:59.433ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27842024-08-16T07:16:59.434ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27852024-08-16T07:16:59.435ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("token = \\"cedc205641a616d175e525d1133fce46875713d9\\"") } result = Ok(())
27862024-08-16T07:16:59.435ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27872024-08-16T07:16:59.435ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27882024-08-16T07:16:59.436ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27892024-08-16T07:16:59.437ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27902024-08-16T07:16:59.438ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27912024-08-16T07:16:59.438ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27922024-08-16T07:16:59.439ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27932024-08-16T07:16:59.439ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27942024-08-16T07:16:59.440ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27952024-08-16T07:16:59.441ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
27962024-08-16T07:16:59.441ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27972024-08-16T07:16:59.441ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27982024-08-16T07:16:59.442ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27992024-08-16T07:16:59.443ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("cedc205641a616d175e525d1133fce46875713d9") } result = Ok(())
28002024-08-16T07:16:59.443ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28012024-08-16T07:16:59.443ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28022024-08-16T07:16:59.446ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28032024-08-16T07:16:59.446ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28042024-08-16T07:16:59.447ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28052024-08-16T07:16:59.447ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28062024-08-16T07:16:59.448ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28072024-08-16T07:16:59.449ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28082024-08-16T07:16:59.450ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28092024-08-16T07:16:59.450ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28102024-08-16T07:16:59.451ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28112024-08-16T07:16:59.452ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
28122024-08-16T07:16:59.452ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28132024-08-16T07:16:59.452ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28142024-08-16T07:16:59.453ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28152024-08-16T07:16:59.454ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28162024-08-16T07:16:59.454ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28172024-08-16T07:16:59.454ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28182024-08-16T07:16:59.455ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28192024-08-16T07:16:59.457ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(())
28202024-08-16T07:16:59.457ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28212024-08-16T07:16:59.457ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28222024-08-16T07:16:59.458ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28232024-08-16T07:16:59.458ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28242024-08-16T07:16:59.459ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28252024-08-16T07:16:59.459ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28262024-08-16T07:16:59.461ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28272024-08-16T07:16:59.461ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28282024-08-16T07:16:59.463ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28292024-08-16T07:16:59.463ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28302024-08-16T07:16:59.465ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28312024-08-16T07:16:59.465ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28322024-08-16T07:16:59.467ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28332024-08-16T07:16:59.467ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28342024-08-16T07:16:59.469ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28352024-08-16T07:16:59.471ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") }, key: d3fb5a5c-10ff-44c5-832d-454a4e847820, lookup_type: ByName("disk-4563d514fe8") } result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28362024-08-16T07:16:59.471ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28372024-08-16T07:16:59.471ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28382024-08-16T07:16:59.473ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28392024-08-16T07:16:59.473ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28402024-08-16T07:16:59.474ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28412024-08-16T07:16:59.474ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28422024-08-16T07:16:59.475ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28432024-08-16T07:16:59.475ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28442024-08-16T07:16:59.477ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28452024-08-16T07:16:59.477ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28462024-08-16T07:16:59.478ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28472024-08-16T07:16:59.478ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28482024-08-16T07:16:59.480ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28492024-08-16T07:16:59.480ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Database result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28502024-08-16T07:16:59.482ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28512024-08-16T07:16:59.485ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ById(45d6a56f-b234-479b-88df-52ddb7b4272c) }, key: d3fb5a5c-10ff-44c5-832d-454a4e847820, lookup_type: ById(d3fb5a5c-10ff-44c5-832d-454a4e847820) } result = Ok(()) uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
28522024-08-16T07:16:59.485ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete
28532024-08-16T07:16:59.485ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[3,4,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","silo_user_id":"f47a9020-f4b2-41e8-804f-a104adfa3a8c"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"a8a230f2-6101-4e8d-94e6-5795d60cec7f"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"final_no_result"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"d3fb5a5c-10ff-44c5-832d-454a4e847820","project_id":"45d6a56f-b234-479b-88df-52ddb7b4272c","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","silo_user_id":"f47a9020-f4b2-41e8-804f-a104adfa3a8c"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"a8a230f2-6101-4e8d-94e6-5795d60cec7f"}}},"End"]},"saga_name":"disk-delete","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28542024-08-16T07:16:59.485ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete
28552024-08-16T07:16:59.488ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete
28562024-08-16T07:16:59.488ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28572024-08-16T07:16:59.488ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28582024-08-16T07:16:59.488ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28592024-08-16T07:16:59.491ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28602024-08-16T07:16:59.491ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28612024-08-16T07:16:59.493ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28622024-08-16T07:16:59.493ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28632024-08-16T07:16:59.504ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28642024-08-16T07:16:59.504ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d3fb5a5c-10ff-44c5-832d-454a4e847820"), "name": String("disk-4563d514fe8"), "time_created": String("2024-08-16T07:16:58.630100Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.630100Z")}, "pantry_address": Null, "project_id": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-08-16T07:16:59.396467Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}) node_id = 0 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28652024-08-16T07:16:59.507ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28662024-08-16T07:16:59.507ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28672024-08-16T07:16:59.509ZDEBGnexus (SagaExecutor): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true roles = RoleSet { roles: {} } saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete saga_node = SpaceAccount
28682024-08-16T07:16:59.509ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true resource = Database result = Ok(()) saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete saga_node = SpaceAccount
28692024-08-16T07:16:59.517ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28702024-08-16T07:16:59.517ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28712024-08-16T07:16:59.520ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28722024-08-16T07:16:59.520ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28732024-08-16T07:16:59.523ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28742024-08-16T07:16:59.523ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "silo_user_id": String("f47a9020-f4b2-41e8-804f-a104adfa3a8c")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}) node_id = 2 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28752024-08-16T07:16:59.525ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28762024-08-16T07:16:59.525ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28772024-08-16T07:16:59.528ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28782024-08-16T07:16:59.528ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28792024-08-16T07:16:59.531ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28802024-08-16T07:16:59.531ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28812024-08-16T07:16:59.546ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28822024-08-16T07:16:59.546ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array []}}) node_id = 4 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28832024-08-16T07:16:59.549ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28842024-08-16T07:16:59.549ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28852024-08-16T07:16:59.551ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28862024-08-16T07:16:59.551ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28872024-08-16T07:16:59.554ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28882024-08-16T07:16:59.554ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28892024-08-16T07:16:59.557ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28902024-08-16T07:16:59.557ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28912024-08-16T07:16:59.559ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28922024-08-16T07:16:59.559ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28932024-08-16T07:16:59.562ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28942024-08-16T07:16:59.562ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28952024-08-16T07:16:59.564ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28962024-08-16T07:16:59.564ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28972024-08-16T07:16:59.567ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
28982024-08-16T07:16:59.567ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
28992024-08-16T07:16:59.569ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
29002024-08-16T07:16:59.569ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
29012024-08-16T07:16:59.650ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
29022024-08-16T07:16:59.650ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:56442
29032024-08-16T07:16:59.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56442 req_id = 101f52aa-ffa9-4763-9e67-48eff4ff9c80 roles = RoleSet { roles: {} } uri = /metrics/producers
29042024-08-16T07:16:59.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56442 req_id = 101f52aa-ffa9-4763-9e67-48eff4ff9c80 resource = Database result = Ok(()) uri = /metrics/producers
29052024-08-16T07:16:59.652ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no oximeter collectors available file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:902 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56442 req_id = 101f52aa-ffa9-4763-9e67-48eff4ff9c80 response_code = 503 uri = /metrics/producers
29062024-08-16T07:16:59.652ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 503, headers: {"content-type": "application/json", "x-request-id": "101f52aa-ffa9-4763-9e67-48eff4ff9c80", "content-length": "133", "date": "Fri, 16 Aug 2024 07:16:59 GMT"} })
29072024-08-16T07:16:59.654ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 100.886771ms file = nexus/src/app/crucible.rs:827 region_id = 82d51a95-d2df-4b6c-8855-0dbfd639af8e saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete
29082024-08-16T07:16:59.654ZWARNnexus (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.100320566s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"101f52aa-ffa9-4763-9e67-48eff4ff9c80\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Fri, 16 Aug 2024 07:16:59 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"101f52aa-ffa9-4763-9e67-48eff4ff9c80\\" }" file = oximeter/producer/src/lib.rs:424
29092024-08-16T07:16:59.757ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 82d51a95-d2df-4b6c-8855-0dbfd639af8e saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete
29102024-08-16T07:16:59.795ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 149.443818ms file = nexus/src/app/crucible.rs:827 region_id = 124a1644-8d10-4218-959f-2b9a64fe0b64 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete
29112024-08-16T07:16:59.948ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 124a1644-8d10-4218-959f-2b9a64fe0b64 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete
29122024-08-16T07:16:59.980ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 79.637741ms file = nexus/src/app/crucible.rs:827 region_id = 874b590c-69ba-41c9-8c19-99ce0ddb1ac8 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete
29132024-08-16T07:17:00.062ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 874b590c-69ba-41c9-8c19-99ce0ddb1ac8 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete
29142024-08-16T07:17:00.070ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
29152024-08-16T07:17:00.070ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
29162024-08-16T07:17:00.072ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
29172024-08-16T07:17:00.072ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
29182024-08-16T07:17:00.077ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
29192024-08-16T07:17:00.077ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
29202024-08-16T07:17:00.079ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
29212024-08-16T07:17:00.079ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
29222024-08-16T07:17:00.081ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
29232024-08-16T07:17:00.081ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
29242024-08-16T07:17:00.083ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
29252024-08-16T07:17:00.083ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
29262024-08-16T07:17:00.085ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
29272024-08-16T07:17:00.085ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
29282024-08-16T07:17:00.087ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
29292024-08-16T07:17:00.087ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486
29302024-08-16T07:17:00.095ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete sec_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
29312024-08-16T07:17:00.095ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = b7848360-7871-4c63-8fcf-5584f8ac6486 saga_name = disk-delete saga_result = SagaResult { saga_id: b7848360-7871-4c63-8fcf-5584f8ac6486, saga_log: SagaLog { saga_id: b7848360-7871-4c63-8fcf-5584f8ac6486, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N005 succeeded, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d3fb5a5c-10ff-44c5-832d-454a4e847820"), "name": String("disk-4563d514fe8"), "time_created": String("2024-08-16T07:16:58.630100Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.630100Z")}, "pantry_address": Null, "project_id": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-08-16T07:16:59.396467Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "silo_user_id": String("f47a9020-f4b2-41e8-804f-a104adfa3a8c")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array []}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array []}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("d3fb5a5c-10ff-44c5-832d-454a4e847820"), "name": String("disk-4563d514fe8"), "time_created": String("2024-08-16T07:16:58.630100Z"), "time_deleted": Null, "time_modified": String("2024-08-16T07:16:58.630100Z")}, "pantry_address": Null, "project_id": String("45d6a56f-b234-479b-88df-52ddb7b4272c"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-08-16T07:16:59.396467Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}, "final_no_result": Null, "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071"), "silo_user_id": String("f47a9020-f4b2-41e8-804f-a104adfa3a8c")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("a8a230f2-6101-4e8d-94e6-5795d60cec7f")}, "volume_delete_subsaga_no_result": Null} }) }
29322024-08-16T07:17:00.095ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 663699 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = be451c2d-d415-4709-bc6c-29ce87677a2e response_code = 204 uri = /v1/disks/disk-4563d514fe8?project=proj-cee044e5e40
29332024-08-16T07:17:00.097ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29342024-08-16T07:17:00.097ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29352024-08-16T07:17:00.098ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29362024-08-16T07:17:00.100ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = DeviceAuthRequestList result = Ok(())
29372024-08-16T07:17:00.100ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29382024-08-16T07:17:00.100ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29392024-08-16T07:17:00.102ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 5858 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = e5f0d1f6-139f-4920-ac0e-92cb43792a98 response_code = 200 uri = /device/auth
29402024-08-16T07:17:00.103ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29412024-08-16T07:17:00.103ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29422024-08-16T07:17:00.104ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29432024-08-16T07:17:00.104ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29442024-08-16T07:17:00.105ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29452024-08-16T07:17:00.106ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("token = \\"cedc205641a616d175e525d1133fce46875713d9\\"") } result = Ok(())
29462024-08-16T07:17:00.106ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29472024-08-16T07:17:00.106ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29482024-08-16T07:17:00.107ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29492024-08-16T07:17:00.107ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29502024-08-16T07:17:00.108ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29512024-08-16T07:17:00.108ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29522024-08-16T07:17:00.109ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29532024-08-16T07:17:00.109ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29542024-08-16T07:17:00.109ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29552024-08-16T07:17:00.110ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
29562024-08-16T07:17:00.110ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29572024-08-16T07:17:00.111ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29582024-08-16T07:17:00.111ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29592024-08-16T07:17:00.112ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("cedc205641a616d175e525d1133fce46875713d9") } result = Ok(())
29602024-08-16T07:17:00.112ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29612024-08-16T07:17:00.112ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29622024-08-16T07:17:00.115ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29632024-08-16T07:17:00.115ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29642024-08-16T07:17:00.115ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29652024-08-16T07:17:00.116ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29662024-08-16T07:17:00.117ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29672024-08-16T07:17:00.117ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29682024-08-16T07:17:00.117ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29692024-08-16T07:17:00.117ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29702024-08-16T07:17:00.118ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29712024-08-16T07:17:00.119ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
29722024-08-16T07:17:00.119ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29732024-08-16T07:17:00.119ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29742024-08-16T07:17:00.120ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29752024-08-16T07:17:00.120ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29762024-08-16T07:17:00.121ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
29772024-08-16T07:17:00.121ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
29782024-08-16T07:17:00.122ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
29792024-08-16T07:17:00.123ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(())
29802024-08-16T07:17:00.123ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
29812024-08-16T07:17:00.123ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
29822024-08-16T07:17:00.124ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
29832024-08-16T07:17:00.124ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
29842024-08-16T07:17:00.125ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
29852024-08-16T07:17:00.125ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
29862024-08-16T07:17:00.127ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /device/confirm
29872024-08-16T07:17:00.127ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = DeviceAuthRequest { parent: Fleet, key: "XFCB-VLHM", lookup_type: ByCompositeId("user_code = \\"XFCB-VLHM\\"") } result = Ok(()) uri = /device/confirm
29882024-08-16T07:17:00.127ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
29892024-08-16T07:17:00.127ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
29902024-08-16T07:17:00.128ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
29912024-08-16T07:17:00.128ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
29922024-08-16T07:17:00.129ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
29932024-08-16T07:17:00.129ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
29942024-08-16T07:17:00.130ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
29952024-08-16T07:17:00.130ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
29962024-08-16T07:17:00.132ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
29972024-08-16T07:17:00.132ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
29982024-08-16T07:17:00.133ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /device/confirm
29992024-08-16T07:17:00.134ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(()) uri = /device/confirm
30002024-08-16T07:17:00.135ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
30012024-08-16T07:17:00.135ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
30022024-08-16T07:17:00.136ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
30032024-08-16T07:17:00.136ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
30042024-08-16T07:17:00.137ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /device/confirm
30052024-08-16T07:17:00.138ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = DeviceAuthRequest { parent: Fleet, key: "XFCB-VLHM", lookup_type: ByCompositeId("user_code = \\"XFCB-VLHM\\"") } result = Ok(()) uri = /device/confirm
30062024-08-16T07:17:00.138ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
30072024-08-16T07:17:00.138ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
30082024-08-16T07:17:00.140ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
30092024-08-16T07:17:00.140ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
30102024-08-16T07:17:00.141ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
30112024-08-16T07:17:00.141ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
30122024-08-16T07:17:00.143ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /device/confirm
30132024-08-16T07:17:00.144ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(()) uri = /device/confirm
30142024-08-16T07:17:00.144ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 roles = RoleSet { roles: {} } uri = /device/confirm
30152024-08-16T07:17:00.144ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 resource = Database result = Ok(()) uri = /device/confirm
30162024-08-16T07:17:00.151ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 47918 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 178a0023-9fa9-4426-b88e-1f369d823cb3 response_code = 204 uri = /device/confirm
30172024-08-16T07:17:00.152ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30182024-08-16T07:17:00.152ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30192024-08-16T07:17:00.160ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 8068 local_addr = 172.30.2.6:443 method = POST remote_addr = 10.151.2.100:40839 req_id = 1720b74d-6c0f-4347-8d8b-1a1667771be7 response_code = 200 uri = /device/token
30202024-08-16T07:17:00.164ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30212024-08-16T07:17:00.164ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30222024-08-16T07:17:00.164ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30232024-08-16T07:17:00.165ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30242024-08-16T07:17:00.165ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30252024-08-16T07:17:00.166ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("token = \\"cedc205641a616d175e525d1133fce46875713d9\\"") } result = Ok(())
30262024-08-16T07:17:00.166ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30272024-08-16T07:17:00.166ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30282024-08-16T07:17:00.167ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30292024-08-16T07:17:00.167ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30302024-08-16T07:17:00.168ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30312024-08-16T07:17:00.168ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30322024-08-16T07:17:00.169ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30332024-08-16T07:17:00.169ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30342024-08-16T07:17:00.169ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30352024-08-16T07:17:00.170ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
30362024-08-16T07:17:00.170ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30372024-08-16T07:17:00.171ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30382024-08-16T07:17:00.171ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30392024-08-16T07:17:00.172ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("cedc205641a616d175e525d1133fce46875713d9") } result = Ok(())
30402024-08-16T07:17:00.172ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30412024-08-16T07:17:00.172ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30422024-08-16T07:17:00.175ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30432024-08-16T07:17:00.175ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30442024-08-16T07:17:00.176ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30452024-08-16T07:17:00.176ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30462024-08-16T07:17:00.177ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30472024-08-16T07:17:00.177ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30482024-08-16T07:17:00.177ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30492024-08-16T07:17:00.177ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30502024-08-16T07:17:00.178ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30512024-08-16T07:17:00.179ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
30522024-08-16T07:17:00.179ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30532024-08-16T07:17:00.179ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30542024-08-16T07:17:00.180ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30552024-08-16T07:17:00.180ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30562024-08-16T07:17:00.181ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30572024-08-16T07:17:00.181ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30582024-08-16T07:17:00.181ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30592024-08-16T07:17:00.182ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(())
30602024-08-16T07:17:00.182ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30612024-08-16T07:17:00.183ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30622024-08-16T07:17:00.183ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30632024-08-16T07:17:00.184ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30642024-08-16T07:17:00.185ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30652024-08-16T07:17:00.185ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30662024-08-16T07:17:00.186ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30672024-08-16T07:17:00.186ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30682024-08-16T07:17:00.186ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30692024-08-16T07:17:00.187ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30702024-08-16T07:17:00.188ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30712024-08-16T07:17:00.188ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30722024-08-16T07:17:00.189ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30732024-08-16T07:17:00.189ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30742024-08-16T07:17:00.193ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30752024-08-16T07:17:00.193ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30762024-08-16T07:17:00.194ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30772024-08-16T07:17:00.197ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") }, key: 9868a7bf-e261-41f0-935b-55a42c54d0b6, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30782024-08-16T07:17:00.197ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30792024-08-16T07:17:00.197ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30802024-08-16T07:17:00.198ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30812024-08-16T07:17:00.199ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30822024-08-16T07:17:00.200ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30832024-08-16T07:17:00.200ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30842024-08-16T07:17:00.201ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30852024-08-16T07:17:00.201ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30862024-08-16T07:17:00.203ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30872024-08-16T07:17:00.205ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") }, key: 9868a7bf-e261-41f0-935b-55a42c54d0b6, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30882024-08-16T07:17:00.205ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30892024-08-16T07:17:00.205ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30902024-08-16T07:17:00.207ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30912024-08-16T07:17:00.207ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30922024-08-16T07:17:00.209ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30932024-08-16T07:17:00.210ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30942024-08-16T07:17:00.217ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30952024-08-16T07:17:00.218ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30962024-08-16T07:17:00.233ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 69700 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = e1d64151-aaeb-448f-a6db-78d47e6c205b response_code = 204 uri = /v1/vpc-subnets/default?project=proj-cee044e5e40&vpc=default
30972024-08-16T07:17:00.233ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Signaled
30982024-08-16T07:17:00.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30992024-08-16T07:17:00.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31002024-08-16T07:17:00.234ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31012024-08-16T07:17:00.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31022024-08-16T07:17:00.234ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31032024-08-16T07:17:00.235ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31042024-08-16T07:17:00.235ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31052024-08-16T07:17:00.235ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31062024-08-16T07:17:00.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31072024-08-16T07:17:00.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31082024-08-16T07:17:00.236ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31092024-08-16T07:17:00.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31102024-08-16T07:17:00.237ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("token = \\"cedc205641a616d175e525d1133fce46875713d9\\"") } result = Ok(())
31112024-08-16T07:17:00.237ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31122024-08-16T07:17:00.237ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31132024-08-16T07:17:00.238ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31142024-08-16T07:17:00.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31152024-08-16T07:17:00.238ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31162024-08-16T07:17:00.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31172024-08-16T07:17:00.238ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31182024-08-16T07:17:00.239ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31192024-08-16T07:17:00.240ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31202024-08-16T07:17:00.240ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31212024-08-16T07:17:00.241ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31222024-08-16T07:17:00.241ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31232024-08-16T07:17:00.243ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
31242024-08-16T07:17:00.243ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31252024-08-16T07:17:00.243ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31262024-08-16T07:17:00.244ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31272024-08-16T07:17:00.245ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("cedc205641a616d175e525d1133fce46875713d9") } result = Ok(())
31282024-08-16T07:17:00.245ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31292024-08-16T07:17:00.245ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31302024-08-16T07:17:00.252ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31312024-08-16T07:17:00.252ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31322024-08-16T07:17:00.253ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31332024-08-16T07:17:00.253ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31342024-08-16T07:17:00.254ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31352024-08-16T07:17:00.255ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31362024-08-16T07:17:00.255ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31372024-08-16T07:17:00.255ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31382024-08-16T07:17:00.256ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31392024-08-16T07:17:00.257ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
31402024-08-16T07:17:00.257ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31412024-08-16T07:17:00.257ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31422024-08-16T07:17:00.258ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31432024-08-16T07:17:00.258ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31442024-08-16T07:17:00.259ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31452024-08-16T07:17:00.259ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31462024-08-16T07:17:00.260ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31472024-08-16T07:17:00.261ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(())
31482024-08-16T07:17:00.261ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31492024-08-16T07:17:00.261ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31502024-08-16T07:17:00.262ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31512024-08-16T07:17:00.262ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31522024-08-16T07:17:00.263ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31532024-08-16T07:17:00.263ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31542024-08-16T07:17:00.265ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31552024-08-16T07:17:00.265ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31562024-08-16T07:17:00.266ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31572024-08-16T07:17:00.266ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31582024-08-16T07:17:00.268ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31592024-08-16T07:17:00.268ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31602024-08-16T07:17:00.270ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31612024-08-16T07:17:00.270ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31622024-08-16T07:17:00.271ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31632024-08-16T07:17:00.275ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31642024-08-16T07:17:00.275ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31652024-08-16T07:17:00.275ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31662024-08-16T07:17:00.278ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31672024-08-16T07:17:00.278ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31682024-08-16T07:17:00.280ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31692024-08-16T07:17:00.280ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31702024-08-16T07:17:00.282ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31712024-08-16T07:17:00.282ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31722024-08-16T07:17:00.283ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31732024-08-16T07:17:00.286ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31742024-08-16T07:17:00.286ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31752024-08-16T07:17:00.286ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31762024-08-16T07:17:00.287ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31772024-08-16T07:17:00.287ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31782024-08-16T07:17:00.291ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31792024-08-16T07:17:00.292ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31802024-08-16T07:17:00.293ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31812024-08-16T07:17:00.293ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31822024-08-16T07:17:00.295ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31832024-08-16T07:17:00.295ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31842024-08-16T07:17:00.296ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31852024-08-16T07:17:00.297ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31862024-08-16T07:17:00.298ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31872024-08-16T07:17:00.301ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") }, key: a3f966a5-6bcb-4c1c-890d-338d03f899cb, lookup_type: ById(a3f966a5-6bcb-4c1c-890d-338d03f899cb) } result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31882024-08-16T07:17:00.301ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31892024-08-16T07:17:00.301ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31902024-08-16T07:17:00.304ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31912024-08-16T07:17:00.304ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31922024-08-16T07:17:00.307ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31932024-08-16T07:17:00.307ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31942024-08-16T07:17:00.308ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31952024-08-16T07:17:00.309ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31962024-08-16T07:17:00.310ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31972024-08-16T07:17:00.310ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
31982024-08-16T07:17:00.311ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
31992024-08-16T07:17:00.311ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
32002024-08-16T07:17:00.313ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
32012024-08-16T07:17:00.313ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
32022024-08-16T07:17:00.314ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/vpcs/default?project=proj-cee044e5e40
32032024-08-16T07:17:00.316ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") }, key: e2f53b90-6ef1-4b4b-83c5-c26a39e60412, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
32042024-08-16T07:17:00.316ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-cee044e5e40
32052024-08-16T07:17:00.316ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-cee044e5e40
32062024-08-16T07:17:00.320ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 86043 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = a5a0e286-20b6-4632-9f31-f76d2a38c6c1 response_code = 204 uri = /v1/vpcs/default?project=proj-cee044e5e40
32072024-08-16T07:17:00.321ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32082024-08-16T07:17:00.322ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "69613e58-eb9f-4aeb-a3a2-e93a5936262a", "content-length": "312", "date": "Fri, 16 Aug 2024 07:17:00 GMT"} })
32092024-08-16T07:17:00.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32102024-08-16T07:17:00.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32112024-08-16T07:17:00.323ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32122024-08-16T07:17:00.323ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32132024-08-16T07:17:00.324ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32142024-08-16T07:17:00.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32152024-08-16T07:17:00.324ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32162024-08-16T07:17:00.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32172024-08-16T07:17:00.325ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32182024-08-16T07:17:00.326ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("token = \\"cedc205641a616d175e525d1133fce46875713d9\\"") } result = Ok(())
32192024-08-16T07:17:00.326ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32202024-08-16T07:17:00.326ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32212024-08-16T07:17:00.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32222024-08-16T07:17:00.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32232024-08-16T07:17:00.327ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32242024-08-16T07:17:00.327ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32252024-08-16T07:17:00.328ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32262024-08-16T07:17:00.328ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32272024-08-16T07:17:00.328ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32282024-08-16T07:17:00.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32292024-08-16T07:17:00.329ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32302024-08-16T07:17:00.329ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32312024-08-16T07:17:00.329ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32322024-08-16T07:17:00.330ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32332024-08-16T07:17:00.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32342024-08-16T07:17:00.331ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
32352024-08-16T07:17:00.331ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32362024-08-16T07:17:00.331ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32372024-08-16T07:17:00.331ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32382024-08-16T07:17:00.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32392024-08-16T07:17:00.332ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32402024-08-16T07:17:00.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32412024-08-16T07:17:00.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32422024-08-16T07:17:00.333ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "cedc205641a616d175e525d1133fce46875713d9", lookup_type: ByCompositeId("cedc205641a616d175e525d1133fce46875713d9") } result = Ok(())
32432024-08-16T07:17:00.333ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32442024-08-16T07:17:00.333ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32452024-08-16T07:17:00.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32462024-08-16T07:17:00.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32472024-08-16T07:17:00.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32482024-08-16T07:17:00.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32492024-08-16T07:17:00.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32502024-08-16T07:17:00.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32512024-08-16T07:17:00.335ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32522024-08-16T07:17:00.335ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32532024-08-16T07:17:00.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32542024-08-16T07:17:00.336ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32552024-08-16T07:17:00.336ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32562024-08-16T07:17:00.337ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32572024-08-16T07:17:00.337ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32582024-08-16T07:17:00.338ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32592024-08-16T07:17:00.338ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32602024-08-16T07:17:00.339ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
32612024-08-16T07:17:00.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32622024-08-16T07:17:00.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32632024-08-16T07:17:00.339ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32642024-08-16T07:17:00.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32652024-08-16T07:17:00.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32662024-08-16T07:17:00.340ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: f47a9020-f4b2-41e8-804f-a104adfa3a8c, lookup_type: ById(f47a9020-f4b2-41e8-804f-a104adfa3a8c) } result = Ok(())
32672024-08-16T07:17:00.340ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32682024-08-16T07:17:00.340ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32692024-08-16T07:17:00.340ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32702024-08-16T07:17:00.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32712024-08-16T07:17:00.341ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32722024-08-16T07:17:00.341ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32732024-08-16T07:17:00.341ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32742024-08-16T07:17:00.342ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32752024-08-16T07:17:00.342ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32762024-08-16T07:17:00.343ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32772024-08-16T07:17:00.344ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) } result = Ok(())
32782024-08-16T07:17:00.344ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
32792024-08-16T07:17:00.344ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
32802024-08-16T07:17:00.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
32812024-08-16T07:17:00.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32822024-08-16T07:17:00.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32832024-08-16T07:17:00.345ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
32842024-08-16T07:17:00.345ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
32852024-08-16T07:17:00.346ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
32862024-08-16T07:17:00.346ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
32872024-08-16T07:17:00.347ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32882024-08-16T07:17:00.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32892024-08-16T07:17:00.348ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32902024-08-16T07:17:00.348ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
32912024-08-16T07:17:00.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32922024-08-16T07:17:00.348ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
32932024-08-16T07:17:00.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32942024-08-16T07:17:00.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32952024-08-16T07:17:00.350ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
32962024-08-16T07:17:00.350ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
32972024-08-16T07:17:00.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32982024-08-16T07:17:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32992024-08-16T07:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33002024-08-16T07:17:00.351ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
33012024-08-16T07:17:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33022024-08-16T07:17:00.351ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33032024-08-16T07:17:00.352ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33042024-08-16T07:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33052024-08-16T07:17:00.353ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/projects/proj-cee044e5e40
33062024-08-16T07:17:00.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33072024-08-16T07:17:00.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33082024-08-16T07:17:00.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33092024-08-16T07:17:00.354ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") } result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33102024-08-16T07:17:00.354ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
33112024-08-16T07:17:00.355ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33122024-08-16T07:17:00.356ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
33132024-08-16T07:17:00.356ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33142024-08-16T07:17:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
33152024-08-16T07:17:00.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33162024-08-16T07:17:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33172024-08-16T07:17:00.358ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
33182024-08-16T07:17:00.358ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33192024-08-16T07:17:00.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33202024-08-16T07:17:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33212024-08-16T07:17:00.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33222024-08-16T07:17:00.359ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
33232024-08-16T07:17:00.359ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33242024-08-16T07:17:00.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33252024-08-16T07:17:00.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33262024-08-16T07:17:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33272024-08-16T07:17:00.360ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {(Silo, 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, "admin")} } uri = /v1/projects/proj-cee044e5e40
33282024-08-16T07:17:00.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33292024-08-16T07:17:00.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33302024-08-16T07:17:00.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33312024-08-16T07:17:00.362ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Project { parent: Silo { parent: Fleet, key: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, lookup_type: ById(439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071) }, key: 45d6a56f-b234-479b-88df-52ddb7b4272c, lookup_type: ByName("proj-cee044e5e40") } result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33322024-08-16T07:17:00.362ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
33332024-08-16T07:17:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33342024-08-16T07:17:00.362ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33352024-08-16T07:17:00.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33362024-08-16T07:17:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33372024-08-16T07:17:00.364ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
33382024-08-16T07:17:00.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33392024-08-16T07:17:00.364ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33402024-08-16T07:17:00.365ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
33412024-08-16T07:17:00.365ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33422024-08-16T07:17:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
33432024-08-16T07:17:00.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33442024-08-16T07:17:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33452024-08-16T07:17:00.368ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33462024-08-16T07:17:00.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33472024-08-16T07:17:00.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33482024-08-16T07:17:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33492024-08-16T07:17:00.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33502024-08-16T07:17:00.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33512024-08-16T07:17:00.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33522024-08-16T07:17:00.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33532024-08-16T07:17:00.372ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33542024-08-16T07:17:00.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33552024-08-16T07:17:00.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33562024-08-16T07:17:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33572024-08-16T07:17:00.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33582024-08-16T07:17:00.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
33592024-08-16T07:17:00.377ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33602024-08-16T07:17:00.377ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
33612024-08-16T07:17:00.378ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33622024-08-16T07:17:00.381ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "81595361-58d8-4da1-9830-d77a5fc750c5", "date": "Fri, 16 Aug 2024 07:17:00 GMT"} })
33632024-08-16T07:17:00.383ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 150.546317ms iteration = 2 status = {}
33642024-08-16T07:17:00.391ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
33652024-08-16T07:17:00.391ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33662024-08-16T07:17:00.392ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
33672024-08-16T07:17:00.392ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33682024-08-16T07:17:00.393ZDEBGnexus (dropshot_external): roles actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 roles = RoleSet { roles: {} } uri = /v1/projects/proj-cee044e5e40
33692024-08-16T07:17:00.394ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: f47a9020-f4b2-41e8-804f-a104adfa3a8c, silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, .. }) actor_id = f47a9020-f4b2-41e8-804f-a104adfa3a8c authenticated = true local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 resource = Database result = Ok(()) uri = /v1/projects/proj-cee044e5e40
33702024-08-16T07:17:00.401ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 80479 local_addr = 172.30.2.6:443 method = DELETE remote_addr = 10.151.2.100:40839 req_id = 0fed37c1-9972-4478-bfba-8da0a9702ef7 response_code = 204 uri = /v1/projects/proj-cee044e5e40
33712024-08-16T07:17:00.410ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:37205
33722024-08-16T07:17:00.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:37205 req_id = 7d0d10f7-3828-4bfc-8161-6b9a0e73d095 roles = RoleSet { roles: {} } uri = /metrics/collectors
33732024-08-16T07:17:00.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:37205 req_id = 7d0d10f7-3828-4bfc-8161-6b9a0e73d095 resource = Database result = Ok(()) uri = /metrics/collectors
33742024-08-16T07:17:00.413ZINFOnexus: registered new oximeter metric collection server address = [fd00:1122:3344:101::d]:12223 collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:88
33752024-08-16T07:17:00.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 3507 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::d]:37205 req_id = 7d0d10f7-3828-4bfc-8161-6b9a0e73d095 response_code = 204 uri = /metrics/collectors
33762024-08-16T07:17:00.455ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:41992
33772024-08-16T07:17:00.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41992 req_id = fb8e4487-b4b2-4881-977c-446a5a50dcdb roles = RoleSet { roles: {} } uri = /metrics/collectors/62147b68-6c5f-49df-a144-ebe1b87f0e27/producers?sort_by=id_ascending
33782024-08-16T07:17:00.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41992 req_id = fb8e4487-b4b2-4881-977c-446a5a50dcdb resource = Database result = Ok(()) uri = /metrics/collectors/62147b68-6c5f-49df-a144-ebe1b87f0e27/producers?sort_by=id_ascending
33792024-08-16T07:17:00.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41992 req_id = fb8e4487-b4b2-4881-977c-446a5a50dcdb response_code = 200 uri = /metrics/collectors/62147b68-6c5f-49df-a144-ebe1b87f0e27/producers?sort_by=id_ascending
33802024-08-16T07:17:01.283ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
33812024-08-16T07:17:01.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33822024-08-16T07:17:01.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33832024-08-16T07:17:01.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
33842024-08-16T07:17:01.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
33852024-08-16T07:17:01.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33862024-08-16T07:17:01.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33872024-08-16T07:17:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33882024-08-16T07:17:01.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33892024-08-16T07:17:01.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33902024-08-16T07:17:01.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33912024-08-16T07:17:01.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33922024-08-16T07:17:01.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33932024-08-16T07:17:01.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33942024-08-16T07:17:01.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
33952024-08-16T07:17:01.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33962024-08-16T07:17:01.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33972024-08-16T07:17:01.298ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:87 target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
33982024-08-16T07:17:01.298ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.423766ms iteration = 2 status = {"status":"first target blueprint","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z","time_found":"2024-08-16T07:17:01.298571309Z"}
33992024-08-16T07:17:01.298ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
34002024-08-16T07:17:01.298ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
34012024-08-16T07:17:01.298ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
34022024-08-16T07:17:01.298ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.35\u{b5}s iteration = 2 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
34032024-08-16T07:17:01.298ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34042024-08-16T07:17:01.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34052024-08-16T07:17:01.298ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34062024-08-16T07:17:01.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34072024-08-16T07:17:01.298ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34082024-08-16T07:17:01.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34092024-08-16T07:17:01.299ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34102024-08-16T07:17:01.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34112024-08-16T07:17:01.299ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34122024-08-16T07:17:01.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34132024-08-16T07:17:01.300ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34142024-08-16T07:17:01.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34152024-08-16T07:17:01.301ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34162024-08-16T07:17:01.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34172024-08-16T07:17:01.301ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34182024-08-16T07:17:01.303ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34192024-08-16T07:17:01.303ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34202024-08-16T07:17:01.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34212024-08-16T07:17:01.303ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34222024-08-16T07:17:01.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34232024-08-16T07:17:01.305ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34242024-08-16T07:17:01.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34252024-08-16T07:17:01.305ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34262024-08-16T07:17:01.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34272024-08-16T07:17:01.307ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34282024-08-16T07:17:01.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34292024-08-16T07:17:01.307ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34302024-08-16T07:17:01.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34312024-08-16T07:17:01.309ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34322024-08-16T07:17:01.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34332024-08-16T07:17:01.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34342024-08-16T07:17:01.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34352024-08-16T07:17:01.311ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
34362024-08-16T07:17:01.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.277017ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34372024-08-16T07:17:01.341ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
34382024-08-16T07:17:01.372ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
34392024-08-16T07:17:01.407ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
34402024-08-16T07:17:01.442ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
34412024-08-16T07:17:01.475ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
34422024-08-16T07:17:01.998ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::6)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "413d0713-527b-4275-92b5-c7cab86296bb", "content-length": "64", "date": "Fri, 16 Aug 2024 07:17:01 GMT"} })
34432024-08-16T07:17:01.998ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34442024-08-16T07:17:01.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34452024-08-16T07:17:02.000ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34462024-08-16T07:17:02.001ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34472024-08-16T07:17:02.001ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34482024-08-16T07:17:02.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34492024-08-16T07:17:02.503ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::4)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6a7dc841-55db-4fd9-98e7-5011aceacafe", "content-length": "64", "date": "Fri, 16 Aug 2024 07:17:02 GMT"} })
34502024-08-16T07:17:02.503ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34512024-08-16T07:17:02.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34522024-08-16T07:17:02.505ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34532024-08-16T07:17:02.507ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34542024-08-16T07:17:02.507ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34552024-08-16T07:17:02.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34562024-08-16T07:17:02.535ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::3)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "75158d6b-4244-4f10-8673-23b391a4bf11", "content-length": "64", "date": "Fri, 16 Aug 2024 07:17:02 GMT"} })
34572024-08-16T07:17:02.535ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34582024-08-16T07:17:02.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34592024-08-16T07:17:02.537ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34602024-08-16T07:17:02.538ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34612024-08-16T07:17:02.538ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34622024-08-16T07:17:02.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34632024-08-16T07:17:02.581ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::5)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "071fa00f-7e69-48c1-943c-038e885f4110", "content-length": "64", "date": "Fri, 16 Aug 2024 07:17:02 GMT"} })
34642024-08-16T07:17:02.581ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34652024-08-16T07:17:02.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34662024-08-16T07:17:02.583ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34672024-08-16T07:17:02.584ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34682024-08-16T07:17:02.584ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34692024-08-16T07:17:02.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34702024-08-16T07:17:02.671ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::7)), port: Some(32222), path: "/node/id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "727d34ec-1a7a-4dfa-b348-3a77e84fe8f9", "content-length": "64", "date": "Fri, 16 Aug 2024 07:17:02 GMT"} })
34712024-08-16T07:17:02.671ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34722024-08-16T07:17:02.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34732024-08-16T07:17:02.672ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34742024-08-16T07:17:02.673ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34752024-08-16T07:17:02.674ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34762024-08-16T07:17:02.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34772024-08-16T07:17:02.678ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.380298907s iteration = 2 status = {"nsuccess":5}
34782024-08-16T07:17:02.785ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
34792024-08-16T07:17:02.785ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:38590
34802024-08-16T07:17:02.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38590 req_id = 4fa40b0e-5cff-4756-bbe8-7f226fdc5d5f roles = RoleSet { roles: {} } uri = /metrics/producers
34812024-08-16T07:17:02.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38590 req_id = 4fa40b0e-5cff-4756-bbe8-7f226fdc5d5f resource = Database result = Ok(()) uri = /metrics/producers
34822024-08-16T07:17:02.817ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
34832024-08-16T07:17:02.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38590 req_id = 4fa40b0e-5cff-4756-bbe8-7f226fdc5d5f roles = RoleSet { roles: {} } uri = /metrics/producers
34842024-08-16T07:17:02.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38590 req_id = 4fa40b0e-5cff-4756-bbe8-7f226fdc5d5f resource = Database result = Ok(()) uri = /metrics/producers
34852024-08-16T07:17:02.846ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
34862024-08-16T07:17:02.860ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c5b196da-5443-4b85-8586-ace42f47608f", "date": "Fri, 16 Aug 2024 07:17:02 GMT"} })
34872024-08-16T07:17:02.860ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
34882024-08-16T07:17:02.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 76546 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38590 req_id = 4fa40b0e-5cff-4756-bbe8-7f226fdc5d5f response_code = 201 uri = /metrics/producers
34892024-08-16T07:17:02.862ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "4fa40b0e-5cff-4756-bbe8-7f226fdc5d5f", "content-length": "41", "date": "Fri, 16 Aug 2024 07:17:02 GMT"} })
34902024-08-16T07:17:02.863ZDEBGnexus (producer-registration-task): registered with nexus successfully
34912024-08-16T07:17:02.863ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
34922024-08-16T07:17:11.283ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
34932024-08-16T07:17:11.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34942024-08-16T07:17:11.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34952024-08-16T07:17:11.285ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
34962024-08-16T07:17:11.285ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
34972024-08-16T07:17:11.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34982024-08-16T07:17:11.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34992024-08-16T07:17:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35002024-08-16T07:17:11.287ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35012024-08-16T07:17:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35022024-08-16T07:17:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35032024-08-16T07:17:11.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35042024-08-16T07:17:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35052024-08-16T07:17:11.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35062024-08-16T07:17:11.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35072024-08-16T07:17:11.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35082024-08-16T07:17:11.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
35092024-08-16T07:17:11.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35102024-08-16T07:17:11.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35112024-08-16T07:17:11.299ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
35122024-08-16T07:17:11.299ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.156744ms iteration = 3 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
35132024-08-16T07:17:11.312ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
35142024-08-16T07:17:11.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.411133ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35152024-08-16T07:17:12.890ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:46346 remote_addr = [fd00:1122:3344:101::d]:52239
35162024-08-16T07:17:12.893ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 1c8d27f9-adf6-46c4-8fea-b306fa214b0f response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
35172024-08-16T07:17:14.460ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:36870
35182024-08-16T07:17:14.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36870 req_id = 3280178a-b778-4963-b537-5cae6909b944 roles = RoleSet { roles: {} } uri = /metrics/producers
35192024-08-16T07:17:14.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36870 req_id = 3280178a-b778-4963-b537-5cae6909b944 resource = Database result = Ok(()) uri = /metrics/producers
35202024-08-16T07:17:14.492ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
35212024-08-16T07:17:14.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36870 req_id = 3280178a-b778-4963-b537-5cae6909b944 roles = RoleSet { roles: {} } uri = /metrics/producers
35222024-08-16T07:17:14.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36870 req_id = 3280178a-b778-4963-b537-5cae6909b944 resource = Database result = Ok(()) uri = /metrics/producers
35232024-08-16T07:17:14.519ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
35242024-08-16T07:17:14.519ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ee48f425-74d3-457c-93df-961814cb3a4f", "date": "Fri, 16 Aug 2024 07:17:14 GMT"} })
35252024-08-16T07:17:14.519ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
35262024-08-16T07:17:14.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 59394 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36870 req_id = 3280178a-b778-4963-b537-5cae6909b944 response_code = 201 uri = /metrics/producers
35272024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
35282024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
35292024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35302024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35312024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
35322024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
35332024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35342024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35352024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
35362024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35372024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
35382024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35392024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
35402024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35412024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
35422024-08-16T07:17:21.282ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
35432024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
35442024-08-16T07:17:21.282ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
35452024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35462024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35472024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35482024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35492024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35502024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35512024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35522024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35532024-08-16T07:17:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35542024-08-16T07:17:21.284ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35552024-08-16T07:17:21.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
35562024-08-16T07:17:21.284ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
35572024-08-16T07:17:21.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
35582024-08-16T07:17:21.284ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35592024-08-16T07:17:21.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35602024-08-16T07:17:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35612024-08-16T07:17:21.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35622024-08-16T07:17:21.285ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 660553663 } })
35632024-08-16T07:17:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35642024-08-16T07:17:21.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35652024-08-16T07:17:21.285ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
35662024-08-16T07:17:21.285ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.975519ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35672024-08-16T07:17:21.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35682024-08-16T07:17:21.286ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35692024-08-16T07:17:21.286ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
35702024-08-16T07:17:21.286ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35712024-08-16T07:17:21.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 662211181 } })
35722024-08-16T07:17:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35732024-08-16T07:17:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35742024-08-16T07:17:21.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35752024-08-16T07:17:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35762024-08-16T07:17:21.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
35772024-08-16T07:17:21.288ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
35782024-08-16T07:17:21.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.682205ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35792024-08-16T07:17:21.288ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
35802024-08-16T07:17:21.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35812024-08-16T07:17:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35822024-08-16T07:17:21.288ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35832024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35842024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35852024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35862024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35872024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35882024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35892024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35902024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35912024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35922024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35932024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35942024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35952024-08-16T07:17:21.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35962024-08-16T07:17:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35972024-08-16T07:17:21.290ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
35982024-08-16T07:17:21.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 7.979324ms iteration = 2 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
35992024-08-16T07:17:21.290ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36002024-08-16T07:17:21.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36012024-08-16T07:17:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36022024-08-16T07:17:21.290ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
36032024-08-16T07:17:21.290ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36042024-08-16T07:17:21.290ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
36052024-08-16T07:17:21.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36062024-08-16T07:17:21.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36072024-08-16T07:17:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36082024-08-16T07:17:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36092024-08-16T07:17:21.291ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
36102024-08-16T07:17:21.291ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
36112024-08-16T07:17:21.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36122024-08-16T07:17:21.291ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
36132024-08-16T07:17:21.291ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
36142024-08-16T07:17:21.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36152024-08-16T07:17:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36162024-08-16T07:17:21.291ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 666808037 } })
36172024-08-16T07:17:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36182024-08-16T07:17:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36192024-08-16T07:17:21.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36202024-08-16T07:17:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36212024-08-16T07:17:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36222024-08-16T07:17:21.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36232024-08-16T07:17:21.292ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
36242024-08-16T07:17:21.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36252024-08-16T07:17:21.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36262024-08-16T07:17:21.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36272024-08-16T07:17:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36282024-08-16T07:17:21.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
36292024-08-16T07:17:21.295ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36302024-08-16T07:17:21.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36312024-08-16T07:17:21.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36322024-08-16T07:17:21.300ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36332024-08-16T07:17:21.300ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36342024-08-16T07:17:21.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36352024-08-16T07:17:21.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36362024-08-16T07:17:21.302ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36372024-08-16T07:17:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36382024-08-16T07:17:21.302ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 18.026677ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36392024-08-16T07:17:21.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36402024-08-16T07:17:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36412024-08-16T07:17:21.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36422024-08-16T07:17:21.311ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
36432024-08-16T07:17:21.311ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.486172ms iteration = 4 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
36442024-08-16T07:17:21.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36452024-08-16T07:17:21.312ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36462024-08-16T07:17:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36472024-08-16T07:17:21.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36482024-08-16T07:17:21.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36492024-08-16T07:17:21.313ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36502024-08-16T07:17:21.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36512024-08-16T07:17:21.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36522024-08-16T07:17:21.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36532024-08-16T07:17:21.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36542024-08-16T07:17:21.316ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36552024-08-16T07:17:21.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
36562024-08-16T07:17:21.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36572024-08-16T07:17:21.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36582024-08-16T07:17:21.318ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 36.449452ms iteration = 2 status = 0
36592024-08-16T07:17:21.318ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36602024-08-16T07:17:21.318ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36612024-08-16T07:17:21.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36622024-08-16T07:17:21.325ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
36632024-08-16T07:17:21.325ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36642024-08-16T07:17:21.325ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36652024-08-16T07:17:21.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36662024-08-16T07:17:21.326ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
36672024-08-16T07:17:21.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 35.418128ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
36682024-08-16T07:17:21.335ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
36692024-08-16T07:17:21.335ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 44.16315ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36702024-08-16T07:17:21.335ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
36712024-08-16T07:17:21.335ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 53.503956ms iteration = 4 status = {"physical_disks_added":0}
36722024-08-16T07:17:21.349ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
36732024-08-16T07:17:21.350ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36742024-08-16T07:17:21.350ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 59.037263ms iteration = 2 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
36752024-08-16T07:17:21.418ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
36762024-08-16T07:17:21.418ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36772024-08-16T07:17:21.418ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b20dc462-4a06-4b97-b712-42ccba26ad59", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
36782024-08-16T07:17:21.419ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36792024-08-16T07:17:21.420ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36802024-08-16T07:17:21.436ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
36812024-08-16T07:17:21.436ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36822024-08-16T07:17:21.437ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bff18932-ecc7-4da2-9fce-bde8f126833c", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
36832024-08-16T07:17:21.437ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36842024-08-16T07:17:21.439ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
36852024-08-16T07:17:21.479ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36862024-08-16T07:17:21.520ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
36872024-08-16T07:17:21.521ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36882024-08-16T07:17:21.521ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9c6ce3cb-e834-457f-9770-e19c7e7e3ef0", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
36892024-08-16T07:17:21.521ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36902024-08-16T07:17:21.522ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36912024-08-16T07:17:21.539ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36922024-08-16T07:17:21.548ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36932024-08-16T07:17:21.548ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "65086371-99b0-4cfb-9267-78fdc73233a1", "content-length": "1", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
36942024-08-16T07:17:21.549ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36952024-08-16T07:17:21.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36962024-08-16T07:17:21.551ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 269.303608ms iteration = 2 status = null
36972024-08-16T07:17:21.580ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d8cbf758-56d4-469d-8e88-1f5661f09489", "content-length": "372", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
36982024-08-16T07:17:21.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36992024-08-16T07:17:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37002024-08-16T07:17:21.581ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3ca0d88d-eaf3-4f82-bcc6-e48511c789fd", "content-length": "691", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
37012024-08-16T07:17:21.581ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37022024-08-16T07:17:21.581ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37032024-08-16T07:17:21.581ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37042024-08-16T07:17:21.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37052024-08-16T07:17:21.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37062024-08-16T07:17:21.582ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 300.325485ms iteration = 2 status = {}
37072024-08-16T07:17:21.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37082024-08-16T07:17:21.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37092024-08-16T07:17:21.586ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37102024-08-16T07:17:21.587ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6920a963-22a5-4bc6-b9fe-f2fb06344d17", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
37112024-08-16T07:17:21.588ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 297.541811ms iteration = 3 status = {}
37122024-08-16T07:17:21.591ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 309.502516ms iteration = 2 status = {}
37132024-08-16T07:17:21.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37142024-08-16T07:17:21.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37152024-08-16T07:17:21.639ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
37162024-08-16T07:17:21.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37172024-08-16T07:17:21.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37182024-08-16T07:17:21.646ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37192024-08-16T07:17:21.646ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fadbf843-6599-46e6-a30b-8d86a6c99377", "content-length": "121", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
37202024-08-16T07:17:21.647ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
37212024-08-16T07:17:21.647ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
37222024-08-16T07:17:21.647ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
37232024-08-16T07:17:21.647ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
37242024-08-16T07:17:21.647ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
37252024-08-16T07:17:21.647ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
37262024-08-16T07:17:21.647ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
37272024-08-16T07:17:21.647ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37282024-08-16T07:17:21.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37292024-08-16T07:17:21.648ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37302024-08-16T07:17:21.649ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "04cedbdf-ffb8-466f-ad9a-a90463e26e5e", "content-length": "2", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
37312024-08-16T07:17:21.649ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37322024-08-16T07:17:21.649ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14c311e4-f4e7-4905-b0eb-1b9973ede1a2", "content-length": "52", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
37332024-08-16T07:17:21.649ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
37342024-08-16T07:17:21.649ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37352024-08-16T07:17:21.696ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "602fe081-8581-4e6b-93bc-1c70f95edf3a", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
37362024-08-16T07:17:21.696ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
37372024-08-16T07:17:21.696ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37382024-08-16T07:17:21.697ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a99dc059-ecaa-4a99-a19e-7ad63e5e7b0c", "content-length": "494", "date": "Fri, 16 Aug 2024 07:17:21 GMT"} })
37392024-08-16T07:17:21.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37402024-08-16T07:17:21.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37412024-08-16T07:17:21.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37422024-08-16T07:17:21.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37432024-08-16T07:17:21.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37442024-08-16T07:17:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37452024-08-16T07:17:21.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37462024-08-16T07:17:21.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37472024-08-16T07:17:21.709ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 427.237236ms iteration = 2 status = {}
37482024-08-16T07:17:22.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1332 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 37364d70-03c0-4403-b24f-f46a021797d6 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
37492024-08-16T07:17:23.550ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:39050
37502024-08-16T07:17:23.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39050 req_id = 0f1d2820-1735-4cc6-945e-59cb8b0267ab roles = RoleSet { roles: {} } uri = /metrics/producers
37512024-08-16T07:17:23.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39050 req_id = 0f1d2820-1735-4cc6-945e-59cb8b0267ab resource = Database result = Ok(()) uri = /metrics/producers
37522024-08-16T07:17:23.582ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
37532024-08-16T07:17:23.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39050 req_id = 0f1d2820-1735-4cc6-945e-59cb8b0267ab roles = RoleSet { roles: {} } uri = /metrics/producers
37542024-08-16T07:17:23.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39050 req_id = 0f1d2820-1735-4cc6-945e-59cb8b0267ab resource = Database result = Ok(()) uri = /metrics/producers
37552024-08-16T07:17:23.611ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
37562024-08-16T07:17:23.612ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "16569307-7fce-47db-b569-3462b4bfd516", "date": "Fri, 16 Aug 2024 07:17:23 GMT"} })
37572024-08-16T07:17:23.612ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 48a86640-720d-4ca7-a9c7-97a8f5a86939
37582024-08-16T07:17:23.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 63860 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39050 req_id = 0f1d2820-1735-4cc6-945e-59cb8b0267ab response_code = 201 uri = /metrics/producers
37592024-08-16T07:17:31.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
37602024-08-16T07:17:31.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37612024-08-16T07:17:31.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37622024-08-16T07:17:31.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37632024-08-16T07:17:31.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
37642024-08-16T07:17:31.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
37652024-08-16T07:17:31.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37662024-08-16T07:17:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37672024-08-16T07:17:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37682024-08-16T07:17:31.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37692024-08-16T07:17:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37702024-08-16T07:17:31.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37712024-08-16T07:17:31.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37722024-08-16T07:17:31.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37732024-08-16T07:17:31.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
37742024-08-16T07:17:31.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37752024-08-16T07:17:31.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37762024-08-16T07:17:31.297ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
37772024-08-16T07:17:31.297ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.282683ms iteration = 5 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
37782024-08-16T07:17:31.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37792024-08-16T07:17:31.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37802024-08-16T07:17:31.310ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
37812024-08-16T07:17:31.310ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.805896ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37822024-08-16T07:17:32.224ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38187
37832024-08-16T07:17:32.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38187 req_id = eb77b3b2-ebc0-4bfd-b421-77c911783ac0 roles = RoleSet { roles: {} } uri = /metrics/producers
37842024-08-16T07:17:32.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38187 req_id = eb77b3b2-ebc0-4bfd-b421-77c911783ac0 resource = Database result = Ok(()) uri = /metrics/producers
37852024-08-16T07:17:32.257ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
37862024-08-16T07:17:32.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38187 req_id = eb77b3b2-ebc0-4bfd-b421-77c911783ac0 roles = RoleSet { roles: {} } uri = /metrics/producers
37872024-08-16T07:17:32.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38187 req_id = eb77b3b2-ebc0-4bfd-b421-77c911783ac0 resource = Database result = Ok(()) uri = /metrics/producers
37882024-08-16T07:17:32.292ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
37892024-08-16T07:17:32.293ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d7d695cb-bf54-4393-8f61-eb1454c37ce0", "date": "Fri, 16 Aug 2024 07:17:32 GMT"} })
37902024-08-16T07:17:32.293ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 89fb4a58-54f1-4b77-bc54-dd764b735a68
37912024-08-16T07:17:32.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 69100 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38187 req_id = eb77b3b2-ebc0-4bfd-b421-77c911783ac0 response_code = 201 uri = /metrics/producers
37922024-08-16T07:17:32.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1298 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = c1ccc015-8499-4cdb-bca3-5295fdb9f302 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
37932024-08-16T07:17:41.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
37942024-08-16T07:17:41.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37952024-08-16T07:17:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37962024-08-16T07:17:41.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
37972024-08-16T07:17:41.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
37982024-08-16T07:17:41.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37992024-08-16T07:17:41.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38002024-08-16T07:17:41.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38012024-08-16T07:17:41.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38022024-08-16T07:17:41.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38032024-08-16T07:17:41.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38042024-08-16T07:17:41.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38052024-08-16T07:17:41.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38062024-08-16T07:17:41.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38072024-08-16T07:17:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
38082024-08-16T07:17:41.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38092024-08-16T07:17:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38102024-08-16T07:17:41.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
38112024-08-16T07:17:41.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.270159ms iteration = 6 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
38122024-08-16T07:17:41.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38132024-08-16T07:17:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38142024-08-16T07:17:41.310ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
38152024-08-16T07:17:41.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.610495ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38162024-08-16T07:17:42.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1428 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = ac180a59-d691-4f75-be9c-82f201ce982b response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
38172024-08-16T07:17:46.837ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:46327
38182024-08-16T07:17:46.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46327 req_id = 3d562a3c-d08b-41a7-8197-9d8de0a3f8f4 roles = RoleSet { roles: {} } uri = /metrics/producers
38192024-08-16T07:17:46.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46327 req_id = 3d562a3c-d08b-41a7-8197-9d8de0a3f8f4 resource = Database result = Ok(()) uri = /metrics/producers
38202024-08-16T07:17:46.902ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
38212024-08-16T07:17:46.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46327 req_id = 3d562a3c-d08b-41a7-8197-9d8de0a3f8f4 roles = RoleSet { roles: {} } uri = /metrics/producers
38222024-08-16T07:17:46.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46327 req_id = 3d562a3c-d08b-41a7-8197-9d8de0a3f8f4 resource = Database result = Ok(()) uri = /metrics/producers
38232024-08-16T07:17:46.959ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
38242024-08-16T07:17:46.959ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "49c74be9-a95b-4b90-a207-0f00b5bf4063", "date": "Fri, 16 Aug 2024 07:17:46 GMT"} })
38252024-08-16T07:17:46.959ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 911a2faf-c618-4671-9845-24941ebe21a2
38262024-08-16T07:17:46.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 89096 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46327 req_id = 3d562a3c-d08b-41a7-8197-9d8de0a3f8f4 response_code = 201 uri = /metrics/producers
38272024-08-16T07:17:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
38282024-08-16T07:17:51.282ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
38292024-08-16T07:17:51.282ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
38302024-08-16T07:17:51.282ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38312024-08-16T07:17:51.282ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
38322024-08-16T07:17:51.282ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
38332024-08-16T07:17:51.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38342024-08-16T07:17:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
38352024-08-16T07:17:51.282ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38362024-08-16T07:17:51.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
38372024-08-16T07:17:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
38382024-08-16T07:17:51.282ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
38392024-08-16T07:17:51.282ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
38402024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38412024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
38422024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.2\u{b5}s iteration = 3 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
38432024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
38442024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
38452024-08-16T07:17:51.283ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:07:51.282915590 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38462024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38472024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38482024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
38492024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38502024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
38512024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38522024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
38532024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38542024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
38552024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38562024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
38572024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38582024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
38592024-08-16T07:17:51.283ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
38602024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
38612024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38622024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
38632024-08-16T07:17:51.283ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
38642024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38652024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
38662024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38672024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38682024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38692024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38702024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38712024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38722024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38732024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38742024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38752024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38762024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38772024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38782024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38792024-08-16T07:17:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38802024-08-16T07:17:51.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
38812024-08-16T07:17:51.284ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
38822024-08-16T07:17:51.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
38832024-08-16T07:17:51.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38842024-08-16T07:17:51.284ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38852024-08-16T07:17:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38862024-08-16T07:17:51.284ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 659931263 } })
38872024-08-16T07:17:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38882024-08-16T07:17:51.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38892024-08-16T07:17:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38902024-08-16T07:17:51.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38912024-08-16T07:17:51.285ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
38922024-08-16T07:17:51.285ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.493358ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
38932024-08-16T07:17:51.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38942024-08-16T07:17:51.285ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
38952024-08-16T07:17:51.285ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.60909ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38962024-08-16T07:17:51.285ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38972024-08-16T07:17:51.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38982024-08-16T07:17:51.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38992024-08-16T07:17:51.286ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 662133774 } })
39002024-08-16T07:17:51.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 662346689 } })
39012024-08-16T07:17:51.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39022024-08-16T07:17:51.287ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:07:51.282915590 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39032024-08-16T07:17:51.287ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.281489ms iteration = 2 status = {"expiration":"2024-08-16T07:07:51.282915590Z","pruned":[]}
39042024-08-16T07:17:51.287ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39052024-08-16T07:17:51.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39062024-08-16T07:17:51.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39072024-08-16T07:17:51.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
39082024-08-16T07:17:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39092024-08-16T07:17:51.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39102024-08-16T07:17:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39112024-08-16T07:17:51.289ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39122024-08-16T07:17:51.289ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39132024-08-16T07:17:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39142024-08-16T07:17:51.289ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
39152024-08-16T07:17:51.289ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 7.057073ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
39162024-08-16T07:17:51.289ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 665366999 } })
39172024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39182024-08-16T07:17:51.290ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
39192024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39202024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
39212024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
39222024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39232024-08-16T07:17:51.290ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
39242024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39252024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39262024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39272024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
39282024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39292024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39302024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39312024-08-16T07:17:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39322024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39332024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39342024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39352024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39362024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39372024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39382024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
39392024-08-16T07:17:51.291ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
39402024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
39412024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39422024-08-16T07:17:51.291ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
39432024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39442024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
39452024-08-16T07:17:51.291ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
39462024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39472024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39482024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39492024-08-16T07:17:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39502024-08-16T07:17:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39512024-08-16T07:17:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39522024-08-16T07:17:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39532024-08-16T07:17:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39542024-08-16T07:17:51.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39552024-08-16T07:17:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
39562024-08-16T07:17:51.292ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39572024-08-16T07:17:51.292ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39582024-08-16T07:17:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39592024-08-16T07:17:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39602024-08-16T07:17:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39612024-08-16T07:17:51.292ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39622024-08-16T07:17:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39632024-08-16T07:17:51.293ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
39642024-08-16T07:17:51.293ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.519896ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
39652024-08-16T07:17:51.293ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
39662024-08-16T07:17:51.293ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 1.824452ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
39672024-08-16T07:17:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39682024-08-16T07:17:51.293ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
39692024-08-16T07:17:51.293ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
39702024-08-16T07:17:51.293ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
39712024-08-16T07:17:51.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39722024-08-16T07:17:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39732024-08-16T07:17:51.294ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39742024-08-16T07:17:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39752024-08-16T07:17:51.294ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 669711869 } })
39762024-08-16T07:17:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39772024-08-16T07:17:51.294ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
39782024-08-16T07:17:51.294ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39792024-08-16T07:17:51.294ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
39802024-08-16T07:17:51.294ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
39812024-08-16T07:17:51.294ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
39822024-08-16T07:17:51.294ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39832024-08-16T07:17:51.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39842024-08-16T07:17:51.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39852024-08-16T07:17:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39862024-08-16T07:17:51.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39872024-08-16T07:17:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39882024-08-16T07:17:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
39892024-08-16T07:17:51.295ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39902024-08-16T07:17:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39912024-08-16T07:17:51.295ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39922024-08-16T07:17:51.295ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39932024-08-16T07:17:51.296ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39942024-08-16T07:17:51.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39952024-08-16T07:17:51.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39962024-08-16T07:17:51.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39972024-08-16T07:17:51.296ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
39982024-08-16T07:17:51.296ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39992024-08-16T07:17:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40002024-08-16T07:17:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40012024-08-16T07:17:51.297ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40022024-08-16T07:17:51.297ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
40032024-08-16T07:17:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40042024-08-16T07:17:51.297ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.905376ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40052024-08-16T07:17:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40062024-08-16T07:17:51.297ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40072024-08-16T07:17:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40082024-08-16T07:17:51.298ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40092024-08-16T07:17:51.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40102024-08-16T07:17:51.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40112024-08-16T07:17:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40122024-08-16T07:17:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40132024-08-16T07:17:51.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40142024-08-16T07:17:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40152024-08-16T07:17:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40162024-08-16T07:17:51.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40172024-08-16T07:17:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40182024-08-16T07:17:51.300ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40192024-08-16T07:17:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40202024-08-16T07:17:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40212024-08-16T07:17:51.300ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40222024-08-16T07:17:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40232024-08-16T07:17:51.301ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
40242024-08-16T07:17:51.301ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 18.909647ms iteration = 3 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
40252024-08-16T07:17:51.302ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40262024-08-16T07:17:51.302ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
40272024-08-16T07:17:51.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40282024-08-16T07:17:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40292024-08-16T07:17:51.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40302024-08-16T07:17:51.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40312024-08-16T07:17:51.304ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
40322024-08-16T07:17:51.304ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40332024-08-16T07:17:51.304ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40342024-08-16T07:17:51.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40352024-08-16T07:17:51.304ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.156589ms iteration = 7 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
40362024-08-16T07:17:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40372024-08-16T07:17:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40382024-08-16T07:17:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40392024-08-16T07:17:51.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40402024-08-16T07:17:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40412024-08-16T07:17:51.312ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
40422024-08-16T07:17:51.312ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
40432024-08-16T07:17:51.312ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
40442024-08-16T07:17:51.312ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 29.87336ms iteration = 3 status = {"generation":2}
40452024-08-16T07:17:51.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40462024-08-16T07:17:51.313ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
40472024-08-16T07:17:51.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.112573ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40482024-08-16T07:17:51.313ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40492024-08-16T07:17:51.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40502024-08-16T07:17:51.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40512024-08-16T07:17:51.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40522024-08-16T07:17:51.316ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40532024-08-16T07:17:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40542024-08-16T07:17:51.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40552024-08-16T07:17:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40562024-08-16T07:17:51.318ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40572024-08-16T07:17:51.318ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40582024-08-16T07:17:51.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40592024-08-16T07:17:51.319ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
40602024-08-16T07:17:51.319ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
40612024-08-16T07:17:51.319ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
40622024-08-16T07:17:51.319ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 36.830851ms iteration = 3 status = {"generation":1}
40632024-08-16T07:17:51.320ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40642024-08-16T07:17:51.320ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 36.187386ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40652024-08-16T07:17:51.320ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
40662024-08-16T07:17:51.320ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 37.793083ms iteration = 5 status = {"physical_disks_added":0}
40672024-08-16T07:17:51.325ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
40682024-08-16T07:17:51.325ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40692024-08-16T07:17:51.325ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40702024-08-16T07:17:51.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40712024-08-16T07:17:51.331ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40722024-08-16T07:17:51.331ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40732024-08-16T07:17:51.331ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 48.365297ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40742024-08-16T07:17:51.333ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
40752024-08-16T07:17:51.333ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
40762024-08-16T07:17:51.333ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 42.784228ms iteration = 2 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
40772024-08-16T07:17:51.333ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40782024-08-16T07:17:51.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40792024-08-16T07:17:51.334ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40802024-08-16T07:17:51.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40812024-08-16T07:17:51.336ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40822024-08-16T07:17:51.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40832024-08-16T07:17:51.348ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
40842024-08-16T07:17:51.348ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 65.291908ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
40852024-08-16T07:17:51.350ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
40862024-08-16T07:17:51.350ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40872024-08-16T07:17:51.350ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 59.920614ms iteration = 3 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
40882024-08-16T07:17:51.442ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
40892024-08-16T07:17:51.619ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
40902024-08-16T07:17:51.657ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
40912024-08-16T07:17:51.657ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40922024-08-16T07:17:51.657ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3dbf4063-38d9-4912-8c8c-8a05c81b350e", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:50 GMT"} })
40932024-08-16T07:17:51.657ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40942024-08-16T07:17:51.658ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40952024-08-16T07:17:51.659ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40962024-08-16T07:17:51.685ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
40972024-08-16T07:17:51.685ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40982024-08-16T07:17:51.685ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
40992024-08-16T07:17:51.685ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41002024-08-16T07:17:51.686ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5863ac11-d39b-49f2-8637-8e43c8e13baa", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:50 GMT"} })
41012024-08-16T07:17:51.686ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41022024-08-16T07:17:51.686ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "56a8243d-6958-441a-9e43-986ba784a136", "content-length": "26", "date": "Fri, 16 Aug 2024 07:17:50 GMT"} })
41032024-08-16T07:17:51.686ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41042024-08-16T07:17:51.691ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41052024-08-16T07:17:51.691ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
41062024-08-16T07:17:51.701ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41072024-08-16T07:17:51.701ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5513e1bf-efdc-4913-a665-63fcabbe9139", "content-length": "691", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
41082024-08-16T07:17:51.701ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
41092024-08-16T07:17:51.701ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
41102024-08-16T07:17:51.701ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
41112024-08-16T07:17:51.703ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 420.068121ms iteration = 3 status = {}
41122024-08-16T07:17:51.712ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41132024-08-16T07:17:51.712ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "01f5f358-09c8-4018-9049-430211bb12de", "content-length": "372", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
41142024-08-16T07:17:51.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41152024-08-16T07:17:51.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41162024-08-16T07:17:51.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41172024-08-16T07:17:51.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41182024-08-16T07:17:51.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41192024-08-16T07:17:51.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41202024-08-16T07:17:51.719ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41212024-08-16T07:17:51.720ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "286cd105-a908-477a-acc5-73e50769c943", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
41222024-08-16T07:17:51.722ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 431.944455ms iteration = 4 status = {}
41232024-08-16T07:17:51.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41242024-08-16T07:17:51.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41252024-08-16T07:17:51.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41262024-08-16T07:17:51.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41272024-08-16T07:17:51.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41282024-08-16T07:17:51.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
41292024-08-16T07:17:51.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41302024-08-16T07:17:51.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41312024-08-16T07:17:51.733ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 450.871372ms iteration = 3 status = 0
41322024-08-16T07:17:51.787ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41332024-08-16T07:17:51.787ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a871368a-0c26-427b-80d9-ef377bcbd840", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
41342024-08-16T07:17:51.787ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
41352024-08-16T07:17:51.789ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bba024cc-dade-4b96-8041-433a1358af0a", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
41362024-08-16T07:17:51.789ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
41372024-08-16T07:17:51.790ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f35b7231-7bb5-42a7-8fb2-d010010bdbbd", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
41382024-08-16T07:17:51.790ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
41392024-08-16T07:17:51.792ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
41402024-08-16T07:17:51.792ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 509.291771ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
41412024-08-16T07:17:51.820ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 537.649087ms iteration = 3 status = {}
41422024-08-16T07:17:51.822ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41432024-08-16T07:17:51.823ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "935f5ffe-5ccb-44e2-b0f4-d934f3d3d79a", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41442024-08-16T07:17:51.823ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41452024-08-16T07:17:51.823ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41462024-08-16T07:17:51.824ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0b9f65e1-a2af-43a4-9362-69818f5a5a79", "content-length": "1", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
41472024-08-16T07:17:51.824ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "536eafab-c7cc-4055-98be-2bc49824fa71", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41482024-08-16T07:17:51.824ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41492024-08-16T07:17:51.825ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41502024-08-16T07:17:51.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41512024-08-16T07:17:51.826ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41522024-08-16T07:17:51.826ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 543.750406ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41532024-08-16T07:17:51.827ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 544.509984ms iteration = 3 status = null
41542024-08-16T07:17:51.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41552024-08-16T07:17:51.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41562024-08-16T07:17:51.888ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
41572024-08-16T07:17:51.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41582024-08-16T07:17:51.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41592024-08-16T07:17:51.895ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41602024-08-16T07:17:51.896ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "daaeb498-944c-4f2b-a958-3b9b3d2b93a7", "content-length": "121", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
41612024-08-16T07:17:51.896ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
41622024-08-16T07:17:51.896ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
41632024-08-16T07:17:51.896ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
41642024-08-16T07:17:51.896ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
41652024-08-16T07:17:51.896ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
41662024-08-16T07:17:51.896ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
41672024-08-16T07:17:51.896ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
41682024-08-16T07:17:51.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41692024-08-16T07:17:51.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41702024-08-16T07:17:51.897ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41712024-08-16T07:17:51.898ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1a75d94a-f489-47a0-8cec-137e8335d68f", "content-length": "2", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
41722024-08-16T07:17:51.898ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41732024-08-16T07:17:51.898ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b0789e31-3d05-433e-a2aa-358e9f54b34e", "content-length": "52", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
41742024-08-16T07:17:51.898ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
41752024-08-16T07:17:51.898ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41762024-08-16T07:17:51.947ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f761d966-bea2-4ef1-8ccd-8a47205a2816", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
41772024-08-16T07:17:51.947ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
41782024-08-16T07:17:51.947ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41792024-08-16T07:17:51.948ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "42f00c37-bd49-4a23-a3d3-841a19b2f513", "content-length": "494", "date": "Fri, 16 Aug 2024 07:17:51 GMT"} })
41802024-08-16T07:17:51.948ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41812024-08-16T07:17:51.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41822024-08-16T07:17:51.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41832024-08-16T07:17:51.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41842024-08-16T07:17:51.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41852024-08-16T07:17:51.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41862024-08-16T07:17:51.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41872024-08-16T07:17:51.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41882024-08-16T07:17:51.960ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 677.005974ms iteration = 3 status = {}
41892024-08-16T07:17:52.384ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38892
41902024-08-16T07:17:52.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38892 req_id = 56e88b95-7a6c-4095-b7d7-0b6631c663e4 roles = RoleSet { roles: {} } uri = /metrics/producers
41912024-08-16T07:17:52.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38892 req_id = 56e88b95-7a6c-4095-b7d7-0b6631c663e4 resource = Database result = Ok(()) uri = /metrics/producers
41922024-08-16T07:17:52.415ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
41932024-08-16T07:17:52.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38892 req_id = 56e88b95-7a6c-4095-b7d7-0b6631c663e4 roles = RoleSet { roles: {} } uri = /metrics/producers
41942024-08-16T07:17:52.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38892 req_id = 56e88b95-7a6c-4095-b7d7-0b6631c663e4 resource = Database result = Ok(()) uri = /metrics/producers
41952024-08-16T07:17:52.497ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
41962024-08-16T07:17:52.498ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "98796013-4e2c-40d8-80cf-e675c67a1913", "date": "Fri, 16 Aug 2024 07:17:52 GMT"} })
41972024-08-16T07:17:52.498ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = b9b5cfb7-1d99-4535-948c-195d99b3bf69
41982024-08-16T07:17:52.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 115975 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38892 req_id = 56e88b95-7a6c-4095-b7d7-0b6631c663e4 response_code = 201 uri = /metrics/producers
41992024-08-16T07:17:52.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1304 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 3113a4c7-fcf0-4d2a-89a9-1c080872c1d3 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
42002024-08-16T07:18:01.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
42012024-08-16T07:18:01.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42022024-08-16T07:18:01.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42032024-08-16T07:18:01.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
42042024-08-16T07:18:01.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
42052024-08-16T07:18:01.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42062024-08-16T07:18:01.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42072024-08-16T07:18:01.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42082024-08-16T07:18:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42092024-08-16T07:18:01.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42102024-08-16T07:18:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42112024-08-16T07:18:01.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42122024-08-16T07:18:01.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42132024-08-16T07:18:01.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42142024-08-16T07:18:01.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
42152024-08-16T07:18:01.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42162024-08-16T07:18:01.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42172024-08-16T07:18:01.297ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
42182024-08-16T07:18:01.297ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.681959ms iteration = 8 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
42192024-08-16T07:18:01.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42202024-08-16T07:18:01.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42212024-08-16T07:18:01.311ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
42222024-08-16T07:18:01.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.382022ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42232024-08-16T07:18:02.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1310 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = c0f99017-e16e-4fd1-9f2f-d598da30a994 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
42242024-08-16T07:18:11.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
42252024-08-16T07:18:11.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42262024-08-16T07:18:11.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42272024-08-16T07:18:11.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42282024-08-16T07:18:11.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
42292024-08-16T07:18:11.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
42302024-08-16T07:18:11.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42312024-08-16T07:18:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42322024-08-16T07:18:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42332024-08-16T07:18:11.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42342024-08-16T07:18:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42352024-08-16T07:18:11.286ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42362024-08-16T07:18:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42372024-08-16T07:18:11.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42382024-08-16T07:18:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42392024-08-16T07:18:11.288ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
42402024-08-16T07:18:11.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.269925ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42412024-08-16T07:18:11.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42422024-08-16T07:18:11.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
42432024-08-16T07:18:11.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42442024-08-16T07:18:11.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42452024-08-16T07:18:11.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
42462024-08-16T07:18:11.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 13.646785ms iteration = 9 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
42472024-08-16T07:18:12.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1299 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 29bafa78-410c-4958-80e1-14ad5a9dba5b response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
42482024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
42492024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
42502024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42512024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
42522024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42532024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42542024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
42552024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
42562024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42572024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42582024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
42592024-08-16T07:18:21.282ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
42602024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
42612024-08-16T07:18:21.282ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
42622024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
42632024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42642024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
42652024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42662024-08-16T07:18:21.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42672024-08-16T07:18:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42682024-08-16T07:18:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42692024-08-16T07:18:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42702024-08-16T07:18:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42712024-08-16T07:18:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42722024-08-16T07:18:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42732024-08-16T07:18:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42742024-08-16T07:18:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42752024-08-16T07:18:21.284ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
42762024-08-16T07:18:21.284ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 1.662768ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
42772024-08-16T07:18:21.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
42782024-08-16T07:18:21.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
42792024-08-16T07:18:21.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42802024-08-16T07:18:21.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42812024-08-16T07:18:21.284ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
42822024-08-16T07:18:21.284ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42832024-08-16T07:18:21.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42842024-08-16T07:18:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42852024-08-16T07:18:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42862024-08-16T07:18:21.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42872024-08-16T07:18:21.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42882024-08-16T07:18:21.285ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1164, tv_nsec: 661417770 } })
42892024-08-16T07:18:21.286ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42902024-08-16T07:18:21.286ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
42912024-08-16T07:18:21.286ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42922024-08-16T07:18:21.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1164, tv_nsec: 662347161 } })
42932024-08-16T07:18:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42942024-08-16T07:18:21.287ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
42952024-08-16T07:18:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
42962024-08-16T07:18:21.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42972024-08-16T07:18:21.288ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
42982024-08-16T07:18:21.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.590203ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42992024-08-16T07:18:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43002024-08-16T07:18:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43012024-08-16T07:18:21.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43022024-08-16T07:18:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43032024-08-16T07:18:21.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43042024-08-16T07:18:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43052024-08-16T07:18:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43062024-08-16T07:18:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43072024-08-16T07:18:21.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43082024-08-16T07:18:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43092024-08-16T07:18:21.289ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
43102024-08-16T07:18:21.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43112024-08-16T07:18:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43122024-08-16T07:18:21.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43132024-08-16T07:18:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43142024-08-16T07:18:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43152024-08-16T07:18:21.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43162024-08-16T07:18:21.290ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
43172024-08-16T07:18:21.290ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
43182024-08-16T07:18:21.290ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43192024-08-16T07:18:21.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43202024-08-16T07:18:21.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43212024-08-16T07:18:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43222024-08-16T07:18:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43232024-08-16T07:18:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43242024-08-16T07:18:21.290ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1164, tv_nsec: 666081187 } })
43252024-08-16T07:18:21.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43262024-08-16T07:18:21.291ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
43272024-08-16T07:18:21.291ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
43282024-08-16T07:18:21.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43292024-08-16T07:18:21.291ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
43302024-08-16T07:18:21.291ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
43312024-08-16T07:18:21.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43322024-08-16T07:18:21.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43332024-08-16T07:18:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43342024-08-16T07:18:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43352024-08-16T07:18:21.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43362024-08-16T07:18:21.291ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
43372024-08-16T07:18:21.292ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43382024-08-16T07:18:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43392024-08-16T07:18:21.292ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
43402024-08-16T07:18:21.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.30671ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
43412024-08-16T07:18:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43422024-08-16T07:18:21.293ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43432024-08-16T07:18:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43442024-08-16T07:18:21.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43452024-08-16T07:18:21.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43462024-08-16T07:18:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43472024-08-16T07:18:21.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43482024-08-16T07:18:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43492024-08-16T07:18:21.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43502024-08-16T07:18:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
43512024-08-16T07:18:21.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43522024-08-16T07:18:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43532024-08-16T07:18:21.296ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43542024-08-16T07:18:21.296ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 11.526246ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43552024-08-16T07:18:21.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43562024-08-16T07:18:21.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43572024-08-16T07:18:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43582024-08-16T07:18:21.308ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
43592024-08-16T07:18:21.308ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.057642ms iteration = 10 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
43602024-08-16T07:18:21.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43612024-08-16T07:18:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43622024-08-16T07:18:21.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43632024-08-16T07:18:21.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43642024-08-16T07:18:21.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43652024-08-16T07:18:21.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43662024-08-16T07:18:21.312ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43672024-08-16T07:18:21.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43682024-08-16T07:18:21.313ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43692024-08-16T07:18:21.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43702024-08-16T07:18:21.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43712024-08-16T07:18:21.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43722024-08-16T07:18:21.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43732024-08-16T07:18:21.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43742024-08-16T07:18:21.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43752024-08-16T07:18:21.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
43762024-08-16T07:18:21.319ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43772024-08-16T07:18:21.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43782024-08-16T07:18:21.320ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43792024-08-16T07:18:21.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43802024-08-16T07:18:21.321ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 38.889358ms iteration = 4 status = 0
43812024-08-16T07:18:21.322ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
43822024-08-16T07:18:21.322ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 40.017715ms iteration = 4 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
43832024-08-16T07:18:21.324ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
43842024-08-16T07:18:21.324ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43852024-08-16T07:18:21.324ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43862024-08-16T07:18:21.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43872024-08-16T07:18:21.326ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43882024-08-16T07:18:21.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43892024-08-16T07:18:21.350ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
43902024-08-16T07:18:21.350ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43912024-08-16T07:18:21.350ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 60.819475ms iteration = 4 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
43922024-08-16T07:18:21.350ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
43932024-08-16T07:18:21.350ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.887533ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
43942024-08-16T07:18:21.381ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
43952024-08-16T07:18:21.381ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 99.059048ms iteration = 6 status = {"physical_disks_added":0}
43962024-08-16T07:18:21.425ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
43972024-08-16T07:18:21.425ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43982024-08-16T07:18:21.425ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7fa04085-efe4-4ed8-892a-0cf810f6a124", "content-length": "26", "date": "Fri, 16 Aug 2024 07:18:21 GMT"} })
43992024-08-16T07:18:21.425ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44002024-08-16T07:18:21.427ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44012024-08-16T07:18:21.434ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
44022024-08-16T07:18:21.434ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44032024-08-16T07:18:21.435ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "54aa3b50-6938-4821-b834-5b40753af472", "content-length": "26", "date": "Fri, 16 Aug 2024 07:18:21 GMT"} })
44042024-08-16T07:18:21.435ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44052024-08-16T07:18:21.437ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
44062024-08-16T07:18:21.438ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44072024-08-16T07:18:21.439ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14ac9b97-6c61-44eb-b421-8bb8eda8cfa8", "content-length": "372", "date": "Fri, 16 Aug 2024 07:18:21 GMT"} })
44082024-08-16T07:18:21.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44092024-08-16T07:18:21.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44102024-08-16T07:18:21.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44112024-08-16T07:18:21.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44122024-08-16T07:18:21.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44132024-08-16T07:18:21.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44142024-08-16T07:18:21.447ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44152024-08-16T07:18:21.447ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "942962c8-cbdf-4ba4-aa0f-34e35038b738", "date": "Fri, 16 Aug 2024 07:18:21 GMT"} })
44162024-08-16T07:18:21.448ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 158.678864ms iteration = 5 status = {}
44172024-08-16T07:18:21.510ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
44182024-08-16T07:18:21.510ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44192024-08-16T07:18:21.511ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aa041261-a5d9-4951-8759-9a1644d0885c", "content-length": "26", "date": "Fri, 16 Aug 2024 07:18:21 GMT"} })
44202024-08-16T07:18:21.511ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44212024-08-16T07:18:21.512ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44222024-08-16T07:18:21.534ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44232024-08-16T07:18:21.535ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dfdd7a9c-29d9-44de-b1f2-c9d1b2cfbbdf", "content-length": "691", "date": "Fri, 16 Aug 2024 07:18:21 GMT"} })
44242024-08-16T07:18:21.535ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
44252024-08-16T07:18:21.535ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
44262024-08-16T07:18:21.535ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
44272024-08-16T07:18:21.536ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 254.232702ms iteration = 4 status = {}
44282024-08-16T07:18:21.544ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 261.775076ms iteration = 4 status = {}
44292024-08-16T07:18:21.579ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44302024-08-16T07:18:21.579ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7f0bd53f-bd5a-4502-9b34-019be09d3a43", "content-length": "1", "date": "Fri, 16 Aug 2024 07:18:21 GMT"} })
44312024-08-16T07:18:21.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44322024-08-16T07:18:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44332024-08-16T07:18:21.582ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 300.284395ms iteration = 4 status = null
44342024-08-16T07:18:21.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44352024-08-16T07:18:21.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44362024-08-16T07:18:21.631ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
44372024-08-16T07:18:21.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44382024-08-16T07:18:21.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44392024-08-16T07:18:21.638ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44402024-08-16T07:18:21.638ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "63b80d53-3a3a-42b4-a39e-be2560ca1240", "content-length": "121", "date": "Fri, 16 Aug 2024 07:18:21 GMT"} })
44412024-08-16T07:18:21.638ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
44422024-08-16T07:18:21.638ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
44432024-08-16T07:18:21.638ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
44442024-08-16T07:18:21.638ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
44452024-08-16T07:18:21.638ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
44462024-08-16T07:18:21.638ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
44472024-08-16T07:18:21.638ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
44482024-08-16T07:18:21.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44492024-08-16T07:18:21.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44502024-08-16T07:18:21.639ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44512024-08-16T07:18:21.639ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c87cd86a-452e-4e32-bb52-a8d13114d379", "content-length": "2", "date": "Fri, 16 Aug 2024 07:18:21 GMT"} })
44522024-08-16T07:18:21.639ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44532024-08-16T07:18:21.640ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "045794a9-55ab-4bae-9457-673f783b71cc", "content-length": "52", "date": "Fri, 16 Aug 2024 07:18:21 GMT"} })
44542024-08-16T07:18:21.640ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
44552024-08-16T07:18:21.640ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44562024-08-16T07:18:21.690ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b4bd4e0b-6a21-4294-ba69-255283397479", "date": "Fri, 16 Aug 2024 07:18:21 GMT"} })
44572024-08-16T07:18:21.690ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
44582024-08-16T07:18:21.690ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44592024-08-16T07:18:21.691ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3ee874d6-c52f-48b9-8412-ed6fee617292", "content-length": "494", "date": "Fri, 16 Aug 2024 07:18:21 GMT"} })
44602024-08-16T07:18:21.691ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44612024-08-16T07:18:21.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44622024-08-16T07:18:21.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44632024-08-16T07:18:21.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44642024-08-16T07:18:21.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44652024-08-16T07:18:21.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44662024-08-16T07:18:21.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44672024-08-16T07:18:21.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44682024-08-16T07:18:21.704ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 421.467583ms iteration = 4 status = {}
44692024-08-16T07:18:22.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1368 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 6940b376-8544-424c-bede-143e7caa92d3 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
44702024-08-16T07:18:31.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
44712024-08-16T07:18:31.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44722024-08-16T07:18:31.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44732024-08-16T07:18:31.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
44742024-08-16T07:18:31.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
44752024-08-16T07:18:31.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44762024-08-16T07:18:31.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44772024-08-16T07:18:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44782024-08-16T07:18:31.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44792024-08-16T07:18:31.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44802024-08-16T07:18:31.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44812024-08-16T07:18:31.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44822024-08-16T07:18:31.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44832024-08-16T07:18:31.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44842024-08-16T07:18:31.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
44852024-08-16T07:18:31.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44862024-08-16T07:18:31.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44872024-08-16T07:18:31.299ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
44882024-08-16T07:18:31.299ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.29048ms iteration = 11 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
44892024-08-16T07:18:31.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44902024-08-16T07:18:31.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44912024-08-16T07:18:31.313ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
44922024-08-16T07:18:31.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.290886ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44932024-08-16T07:18:32.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1314 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = f00df596-b356-4e28-89bf-e77a46813a7b response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
44942024-08-16T07:18:41.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
44952024-08-16T07:18:41.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44962024-08-16T07:18:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44972024-08-16T07:18:41.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44982024-08-16T07:18:41.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
44992024-08-16T07:18:41.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
45002024-08-16T07:18:41.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45012024-08-16T07:18:41.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45022024-08-16T07:18:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45032024-08-16T07:18:41.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45042024-08-16T07:18:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45052024-08-16T07:18:41.286ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45062024-08-16T07:18:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45072024-08-16T07:18:41.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45082024-08-16T07:18:41.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45092024-08-16T07:18:41.288ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
45102024-08-16T07:18:41.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.608153ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45112024-08-16T07:18:41.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45122024-08-16T07:18:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
45132024-08-16T07:18:41.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45142024-08-16T07:18:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45152024-08-16T07:18:41.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
45162024-08-16T07:18:41.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.365012ms iteration = 12 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
45172024-08-16T07:18:42.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1302 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 27f716ae-4c25-4be0-8b6b-bf43e2208c0e response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
45182024-08-16T07:18:51.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
45192024-08-16T07:18:51.282ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
45202024-08-16T07:18:51.282ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45212024-08-16T07:18:51.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45222024-08-16T07:18:51.282ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
45232024-08-16T07:18:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
45242024-08-16T07:18:51.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45252024-08-16T07:18:51.282ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
45262024-08-16T07:18:51.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45272024-08-16T07:18:51.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
45282024-08-16T07:18:51.283ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
45292024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
45302024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45312024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
45322024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45332024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
45342024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45352024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
45362024-08-16T07:18:51.283ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
45372024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
45382024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
45392024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45402024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
45412024-08-16T07:18:51.283ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
45422024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45432024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
45442024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
45452024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
45462024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45472024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
45482024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
45492024-08-16T07:18:51.283ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:08:51.283051834 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
45502024-08-16T07:18:51.283ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
45512024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
45522024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
45532024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.45\u{b5}s iteration = 4 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
45542024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
45552024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45562024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
45572024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
45582024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45592024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45602024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45612024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45622024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45632024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
45642024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45652024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45662024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45672024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45682024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45692024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
45702024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45712024-08-16T07:18:51.283ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 659453398 } })
45722024-08-16T07:18:51.283ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 659555571 } })
45732024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
45742024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
45752024-08-16T07:18:51.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
45762024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45772024-08-16T07:18:51.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45782024-08-16T07:18:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45792024-08-16T07:18:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45802024-08-16T07:18:51.284ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
45812024-08-16T07:18:51.284ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.75625ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
45822024-08-16T07:18:51.285ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45832024-08-16T07:18:51.285ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
45842024-08-16T07:18:51.285ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.923187ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
45852024-08-16T07:18:51.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45862024-08-16T07:18:51.285ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 661584477 } })
45872024-08-16T07:18:51.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45882024-08-16T07:18:51.286ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45892024-08-16T07:18:51.286ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
45902024-08-16T07:18:51.286ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.683805ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45912024-08-16T07:18:51.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45922024-08-16T07:18:51.286ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
45932024-08-16T07:18:51.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45942024-08-16T07:18:51.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45952024-08-16T07:18:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45962024-08-16T07:18:51.287ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 663551133 } })
45972024-08-16T07:18:51.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45982024-08-16T07:18:51.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45992024-08-16T07:18:51.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46002024-08-16T07:18:51.288ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46012024-08-16T07:18:51.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46022024-08-16T07:18:51.289ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
46032024-08-16T07:18:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46042024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
46052024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46062024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46072024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46082024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46092024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46102024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
46112024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
46122024-08-16T07:18:51.290ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
46132024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46142024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
46152024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46162024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
46172024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46182024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46192024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
46202024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46212024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46222024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46232024-08-16T07:18:51.290ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46242024-08-16T07:18:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46252024-08-16T07:18:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46262024-08-16T07:18:51.291ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46272024-08-16T07:18:51.291ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
46282024-08-16T07:18:51.291ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
46292024-08-16T07:18:51.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46302024-08-16T07:18:51.291ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
46312024-08-16T07:18:51.291ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
46322024-08-16T07:18:51.291ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
46332024-08-16T07:18:51.291ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
46342024-08-16T07:18:51.291ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
46352024-08-16T07:18:51.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46362024-08-16T07:18:51.292ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 667888093 } })
46372024-08-16T07:18:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46382024-08-16T07:18:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46392024-08-16T07:18:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
46402024-08-16T07:18:51.292ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:08:51.283051834 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
46412024-08-16T07:18:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.248314ms iteration = 3 status = {"expiration":"2024-08-16T07:08:51.283051834Z","pruned":[]}
46422024-08-16T07:18:51.292ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
46432024-08-16T07:18:51.292ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46442024-08-16T07:18:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46452024-08-16T07:18:51.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46462024-08-16T07:18:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46472024-08-16T07:18:51.293ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46482024-08-16T07:18:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46492024-08-16T07:18:51.293ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
46502024-08-16T07:18:51.293ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 10.915702ms iteration = 5 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
46512024-08-16T07:18:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46522024-08-16T07:18:51.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46532024-08-16T07:18:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46542024-08-16T07:18:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46552024-08-16T07:18:51.294ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46562024-08-16T07:18:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46572024-08-16T07:18:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46582024-08-16T07:18:51.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46592024-08-16T07:18:51.294ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46602024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46612024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
46622024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
46632024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
46642024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46652024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46662024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46672024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46682024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46692024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46702024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46712024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46722024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46732024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46742024-08-16T07:18:51.295ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46752024-08-16T07:18:51.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46762024-08-16T07:18:51.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46772024-08-16T07:18:51.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46782024-08-16T07:18:51.296ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
46792024-08-16T07:18:51.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.615481ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46802024-08-16T07:18:51.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46812024-08-16T07:18:51.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46822024-08-16T07:18:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
46832024-08-16T07:18:51.297ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46842024-08-16T07:18:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46852024-08-16T07:18:51.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46862024-08-16T07:18:51.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46872024-08-16T07:18:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46882024-08-16T07:18:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
46892024-08-16T07:18:51.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46902024-08-16T07:18:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46912024-08-16T07:18:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46922024-08-16T07:18:51.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46932024-08-16T07:18:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46942024-08-16T07:18:51.303ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46952024-08-16T07:18:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46962024-08-16T07:18:51.307ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
46972024-08-16T07:18:51.307ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.096452ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
46982024-08-16T07:18:51.313ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46992024-08-16T07:18:51.314ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47002024-08-16T07:18:51.314ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47012024-08-16T07:18:51.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47022024-08-16T07:18:51.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47032024-08-16T07:18:51.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47042024-08-16T07:18:51.316ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47052024-08-16T07:18:51.318ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47062024-08-16T07:18:51.318ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47072024-08-16T07:18:51.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47082024-08-16T07:18:51.319ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47092024-08-16T07:18:51.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47102024-08-16T07:18:51.320ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47112024-08-16T07:18:51.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47122024-08-16T07:18:51.321ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
47132024-08-16T07:18:51.321ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.280814ms iteration = 13 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
47142024-08-16T07:18:51.323ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
47152024-08-16T07:18:51.323ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47162024-08-16T07:18:51.323ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47172024-08-16T07:18:51.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47182024-08-16T07:18:51.324ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
47192024-08-16T07:18:51.325ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
47202024-08-16T07:18:51.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47212024-08-16T07:18:51.325ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
47222024-08-16T07:18:51.325ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47232024-08-16T07:18:51.325ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 34.607169ms iteration = 5 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
47242024-08-16T07:18:51.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47252024-08-16T07:18:51.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47262024-08-16T07:18:51.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47272024-08-16T07:18:51.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47282024-08-16T07:18:51.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47292024-08-16T07:18:51.329ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47302024-08-16T07:18:51.329ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 45.4769ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47312024-08-16T07:18:51.331ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
47322024-08-16T07:18:51.331ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
47332024-08-16T07:18:51.331ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
47342024-08-16T07:18:51.331ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 48.449079ms iteration = 4 status = {"generation":1}
47352024-08-16T07:18:51.334ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
47362024-08-16T07:18:51.334ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
47372024-08-16T07:18:51.334ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 43.7268ms iteration = 3 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
47382024-08-16T07:18:51.334ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
47392024-08-16T07:18:51.334ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.069205ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
47402024-08-16T07:18:51.335ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
47412024-08-16T07:18:51.335ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
47422024-08-16T07:18:51.335ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 52.235656ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
47432024-08-16T07:18:51.335ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47442024-08-16T07:18:51.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47452024-08-16T07:18:51.336ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
47462024-08-16T07:18:51.336ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
47472024-08-16T07:18:51.336ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
47482024-08-16T07:18:51.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47492024-08-16T07:18:51.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47502024-08-16T07:18:51.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47512024-08-16T07:18:51.339ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47522024-08-16T07:18:51.339ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47532024-08-16T07:18:51.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47542024-08-16T07:18:51.340ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
47552024-08-16T07:18:51.340ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
47562024-08-16T07:18:51.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47572024-08-16T07:18:51.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47582024-08-16T07:18:51.341ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47592024-08-16T07:18:51.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47602024-08-16T07:18:51.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47612024-08-16T07:18:51.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47622024-08-16T07:18:51.345ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
47632024-08-16T07:18:51.345ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
47642024-08-16T07:18:51.345ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
47652024-08-16T07:18:51.345ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 62.288909ms iteration = 4 status = {"generation":2}
47662024-08-16T07:18:51.364ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
47672024-08-16T07:18:51.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 72.403253ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
47682024-08-16T07:18:51.365ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
47692024-08-16T07:18:51.365ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 82.498865ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
47702024-08-16T07:18:51.454ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
47712024-08-16T07:18:51.454ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47722024-08-16T07:18:51.456ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d3d95a2e-9ac3-45ec-b628-38d3da1e335c", "content-length": "26", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
47732024-08-16T07:18:51.456ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47742024-08-16T07:18:51.459ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47752024-08-16T07:18:51.485ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
47762024-08-16T07:18:51.485ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47772024-08-16T07:18:51.485ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6d848cd4-f956-45ed-ab8b-8c9c4459766b", "content-length": "26", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
47782024-08-16T07:18:51.485ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47792024-08-16T07:18:51.487ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47802024-08-16T07:18:51.495ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47812024-08-16T07:18:51.497ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
47822024-08-16T07:18:51.497ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47832024-08-16T07:18:51.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47842024-08-16T07:18:51.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47852024-08-16T07:18:51.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47862024-08-16T07:18:51.500ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47872024-08-16T07:18:51.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47882024-08-16T07:18:51.510ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
47892024-08-16T07:18:51.511ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
47902024-08-16T07:18:51.511ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 228.605539ms iteration = 7 status = {"physical_disks_added":0}
47912024-08-16T07:18:51.520ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b31d0260-1fb1-4deb-9100-76259dc78d1f", "content-length": "691", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
47922024-08-16T07:18:51.520ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
47932024-08-16T07:18:51.520ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
47942024-08-16T07:18:51.520ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
47952024-08-16T07:18:51.522ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 239.496511ms iteration = 5 status = {}
47962024-08-16T07:18:51.537ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47972024-08-16T07:18:51.537ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7aeed3f5-5929-460f-8f5c-8e7d6538b98d", "content-length": "372", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
47982024-08-16T07:18:51.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47992024-08-16T07:18:51.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48002024-08-16T07:18:51.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48012024-08-16T07:18:51.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48022024-08-16T07:18:51.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48032024-08-16T07:18:51.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48042024-08-16T07:18:51.544ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48052024-08-16T07:18:51.544ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "070ef5c7-d4ba-4546-8bc1-81c0bdbf7ff7", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
48062024-08-16T07:18:51.546ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 255.91835ms iteration = 6 status = {}
48072024-08-16T07:18:51.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48082024-08-16T07:18:51.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48092024-08-16T07:18:51.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48102024-08-16T07:18:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48112024-08-16T07:18:51.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48122024-08-16T07:18:51.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
48132024-08-16T07:18:51.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48142024-08-16T07:18:51.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48152024-08-16T07:18:51.559ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 276.802053ms iteration = 5 status = 0
48162024-08-16T07:18:51.633ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
48172024-08-16T07:18:51.704ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
48182024-08-16T07:18:51.704ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48192024-08-16T07:18:51.705ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dba5a619-8445-400f-9f90-20bf7151a158", "content-length": "26", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
48202024-08-16T07:18:51.705ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48212024-08-16T07:18:51.706ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
48222024-08-16T07:18:51.753ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48232024-08-16T07:18:51.753ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "99563987-ea00-4d62-9ed7-bab1891add44", "content-length": "1", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
48242024-08-16T07:18:51.755ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48252024-08-16T07:18:51.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48262024-08-16T07:18:51.756ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 473.493355ms iteration = 5 status = null
48272024-08-16T07:18:51.781ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
48282024-08-16T07:18:51.782ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b9b90d39-01bd-4bbf-ad6c-b9ad373d86d2", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48292024-08-16T07:18:51.782ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48302024-08-16T07:18:51.785ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "24826746-ce89-4eb9-b5fa-3a4cd128c372", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48312024-08-16T07:18:51.785ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48322024-08-16T07:18:51.786ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48332024-08-16T07:18:51.786ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 503.355185ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
48342024-08-16T07:18:51.816ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 533.260176ms iteration = 5 status = {}
48352024-08-16T07:18:51.835ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
48362024-08-16T07:18:51.898ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
48372024-08-16T07:18:51.899ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4ce2ff99-6e44-44af-8370-9d2167bb6c12", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48382024-08-16T07:18:51.899ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48392024-08-16T07:18:51.900ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9315f909-f84c-4ea6-9b22-fb3d1bc01ddd", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48402024-08-16T07:18:51.900ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48412024-08-16T07:18:51.902ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2de5b565-30f5-419a-be56-fcfee95c8ec4", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48422024-08-16T07:18:51.902ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48432024-08-16T07:18:51.903ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
48442024-08-16T07:18:51.904ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 621.007282ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
48452024-08-16T07:18:51.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48462024-08-16T07:18:51.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48472024-08-16T07:18:51.925ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
48482024-08-16T07:18:51.925ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48492024-08-16T07:18:51.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48502024-08-16T07:18:51.931ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48512024-08-16T07:18:51.931ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a3b17613-f0cf-46f3-9065-4f97634de22d", "content-length": "121", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
48522024-08-16T07:18:51.931ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
48532024-08-16T07:18:51.931ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
48542024-08-16T07:18:51.931ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
48552024-08-16T07:18:51.931ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
48562024-08-16T07:18:51.931ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
48572024-08-16T07:18:51.931ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
48582024-08-16T07:18:51.931ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
48592024-08-16T07:18:51.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48602024-08-16T07:18:51.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48612024-08-16T07:18:51.932ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48622024-08-16T07:18:51.932ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d3d62def-42e5-4c78-8340-264f2782e444", "content-length": "2", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
48632024-08-16T07:18:51.932ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48642024-08-16T07:18:51.932ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ac4e84ca-24e7-4000-895d-444301a97915", "content-length": "52", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
48652024-08-16T07:18:51.932ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
48662024-08-16T07:18:51.932ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48672024-08-16T07:18:51.984ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "088d5ee0-3d9b-4c8a-a72a-4c452b467310", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
48682024-08-16T07:18:51.984ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
48692024-08-16T07:18:51.984ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48702024-08-16T07:18:51.988ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8ecaefed-2056-4327-b790-1aa6f249e53f", "content-length": "494", "date": "Fri, 16 Aug 2024 07:18:51 GMT"} })
48712024-08-16T07:18:51.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48722024-08-16T07:18:51.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48732024-08-16T07:18:51.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48742024-08-16T07:18:51.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48752024-08-16T07:18:51.992ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48762024-08-16T07:18:51.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48772024-08-16T07:18:51.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48782024-08-16T07:18:51.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48792024-08-16T07:18:52.001ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 718.416022ms iteration = 5 status = {}
48802024-08-16T07:18:52.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1314 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 7803e4e4-6bbf-49da-b63e-2e256d84a8ad response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
48812024-08-16T07:19:01.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
48822024-08-16T07:19:01.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48832024-08-16T07:19:01.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48842024-08-16T07:19:01.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
48852024-08-16T07:19:01.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
48862024-08-16T07:19:01.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48872024-08-16T07:19:01.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48882024-08-16T07:19:01.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48892024-08-16T07:19:01.286ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48902024-08-16T07:19:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48912024-08-16T07:19:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48922024-08-16T07:19:01.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48932024-08-16T07:19:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48942024-08-16T07:19:01.287ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
48952024-08-16T07:19:01.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.356798ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48962024-08-16T07:19:01.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48972024-08-16T07:19:01.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48982024-08-16T07:19:01.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48992024-08-16T07:19:01.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
49002024-08-16T07:19:01.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49012024-08-16T07:19:01.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49022024-08-16T07:19:01.298ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
49032024-08-16T07:19:01.298ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.208254ms iteration = 14 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
49042024-08-16T07:19:02.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1327 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = c7ec338c-caa5-4424-8dae-5c0aae7b8577 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
49052024-08-16T07:19:11.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
49062024-08-16T07:19:11.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49072024-08-16T07:19:11.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49082024-08-16T07:19:11.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
49092024-08-16T07:19:11.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
49102024-08-16T07:19:11.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49112024-08-16T07:19:11.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49122024-08-16T07:19:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49132024-08-16T07:19:11.286ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49142024-08-16T07:19:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49152024-08-16T07:19:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49162024-08-16T07:19:11.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49172024-08-16T07:19:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49182024-08-16T07:19:11.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49192024-08-16T07:19:11.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49202024-08-16T07:19:11.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49212024-08-16T07:19:11.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
49222024-08-16T07:19:11.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49232024-08-16T07:19:11.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49242024-08-16T07:19:11.299ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
49252024-08-16T07:19:11.299ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.708795ms iteration = 15 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
49262024-08-16T07:19:11.314ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
49272024-08-16T07:19:11.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.754647ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49282024-08-16T07:19:12.892ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1848 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = adc5dd8b-3e7f-4747-a098-78816bd2e188 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
49292024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
49302024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
49312024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49322024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
49332024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49342024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
49352024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49362024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49372024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
49382024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49392024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
49402024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49412024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
49422024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49432024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
49442024-08-16T07:19:21.282ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
49452024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49462024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
49472024-08-16T07:19:21.282ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
49482024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49492024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49502024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49512024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49522024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49532024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49542024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49552024-08-16T07:19:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49562024-08-16T07:19:21.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
49572024-08-16T07:19:21.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
49582024-08-16T07:19:21.284ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
49592024-08-16T07:19:21.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49602024-08-16T07:19:21.284ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49612024-08-16T07:19:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49622024-08-16T07:19:21.284ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
49632024-08-16T07:19:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49642024-08-16T07:19:21.284ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.321003ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49652024-08-16T07:19:21.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49662024-08-16T07:19:21.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49672024-08-16T07:19:21.285ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1224, tv_nsec: 661592448 } })
49682024-08-16T07:19:21.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49692024-08-16T07:19:21.286ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49702024-08-16T07:19:21.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49712024-08-16T07:19:21.286ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49722024-08-16T07:19:21.286ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49732024-08-16T07:19:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49742024-08-16T07:19:21.287ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1224, tv_nsec: 663097893 } })
49752024-08-16T07:19:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49762024-08-16T07:19:21.287ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
49772024-08-16T07:19:21.288ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
49782024-08-16T07:19:21.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.565972ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49792024-08-16T07:19:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49802024-08-16T07:19:21.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49812024-08-16T07:19:21.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
49822024-08-16T07:19:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49832024-08-16T07:19:21.288ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
49842024-08-16T07:19:21.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.134972ms iteration = 6 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
49852024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49862024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49872024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49882024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49892024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49902024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49912024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49922024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49932024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49942024-08-16T07:19:21.289ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1224, tv_nsec: 665675213 } })
49952024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
49962024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
49972024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49982024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49992024-08-16T07:19:21.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50002024-08-16T07:19:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50012024-08-16T07:19:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50022024-08-16T07:19:21.290ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
50032024-08-16T07:19:21.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50042024-08-16T07:19:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50052024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
50062024-08-16T07:19:21.291ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
50072024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
50082024-08-16T07:19:21.291ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
50092024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50102024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50112024-08-16T07:19:21.291ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
50122024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50132024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50142024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50152024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50162024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50172024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50182024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50192024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50202024-08-16T07:19:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50212024-08-16T07:19:21.292ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
50222024-08-16T07:19:21.292ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50232024-08-16T07:19:21.292ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50242024-08-16T07:19:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50252024-08-16T07:19:21.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50262024-08-16T07:19:21.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50272024-08-16T07:19:21.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50282024-08-16T07:19:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50292024-08-16T07:19:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50302024-08-16T07:19:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50312024-08-16T07:19:21.293ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50322024-08-16T07:19:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50332024-08-16T07:19:21.293ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
50342024-08-16T07:19:21.293ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50352024-08-16T07:19:21.293ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 3.885019ms iteration = 6 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
50362024-08-16T07:19:21.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50372024-08-16T07:19:21.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50382024-08-16T07:19:21.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50392024-08-16T07:19:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50402024-08-16T07:19:21.296ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50412024-08-16T07:19:21.296ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 11.656109ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50422024-08-16T07:19:21.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50432024-08-16T07:19:21.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50442024-08-16T07:19:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50452024-08-16T07:19:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
50462024-08-16T07:19:21.296ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50472024-08-16T07:19:21.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50482024-08-16T07:19:21.302ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
50492024-08-16T07:19:21.302ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 19.636984ms iteration = 8 status = {"physical_disks_added":0}
50502024-08-16T07:19:21.302ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
50512024-08-16T07:19:21.302ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.486274ms iteration = 16 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
50522024-08-16T07:19:21.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50532024-08-16T07:19:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50542024-08-16T07:19:21.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50552024-08-16T07:19:21.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50562024-08-16T07:19:21.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50572024-08-16T07:19:21.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
50582024-08-16T07:19:21.319ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50592024-08-16T07:19:21.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50602024-08-16T07:19:21.320ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 38.5543ms iteration = 6 status = 0
50612024-08-16T07:19:21.327ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
50622024-08-16T07:19:21.327ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 36.269068ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
50632024-08-16T07:19:21.329ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50642024-08-16T07:19:21.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50652024-08-16T07:19:21.330ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
50662024-08-16T07:19:21.330ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 39.883391ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50672024-08-16T07:19:21.335ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50682024-08-16T07:19:21.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50692024-08-16T07:19:21.336ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50702024-08-16T07:19:21.338ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50712024-08-16T07:19:21.338ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50722024-08-16T07:19:21.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50732024-08-16T07:19:21.339ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50742024-08-16T07:19:21.341ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50752024-08-16T07:19:21.341ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50762024-08-16T07:19:21.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50772024-08-16T07:19:21.410ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
50782024-08-16T07:19:21.410ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50792024-08-16T07:19:21.410ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "41a1cf2b-3ab3-4a0a-82e7-715621fa8839", "content-length": "26", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
50802024-08-16T07:19:21.410ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50812024-08-16T07:19:21.412ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50822024-08-16T07:19:21.421ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
50832024-08-16T07:19:21.421ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50842024-08-16T07:19:21.421ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3d9a657b-a2e4-4a9a-a7e8-4c382dd9a908", "content-length": "26", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
50852024-08-16T07:19:21.421ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50862024-08-16T07:19:21.424ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50872024-08-16T07:19:21.541ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
50882024-08-16T07:19:21.541ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50892024-08-16T07:19:21.541ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5b1033a5-ab70-47fa-82ca-4f56aeaa3cc3", "content-length": "26", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
50902024-08-16T07:19:21.541ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50912024-08-16T07:19:21.543ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
50922024-08-16T07:19:21.554ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50932024-08-16T07:19:21.555ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "09d8e334-fc5f-49d2-b7aa-e0ad39e75666", "content-length": "691", "date": "Fri, 16 Aug 2024 07:19:21 GMT"} })
50942024-08-16T07:19:21.556ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
50952024-08-16T07:19:21.556ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
50962024-08-16T07:19:21.556ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
50972024-08-16T07:19:21.557ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 275.42208ms iteration = 6 status = {}
50982024-08-16T07:19:21.559ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50992024-08-16T07:19:21.559ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9068b9e6-1d90-4f4d-9ee8-497c4192d7ef", "content-length": "372", "date": "Fri, 16 Aug 2024 07:19:21 GMT"} })
51002024-08-16T07:19:21.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51012024-08-16T07:19:21.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51022024-08-16T07:19:21.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51032024-08-16T07:19:21.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51042024-08-16T07:19:21.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51052024-08-16T07:19:21.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51062024-08-16T07:19:21.566ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51072024-08-16T07:19:21.566ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "24879c93-a0a0-4ae9-99e1-710d2c6317bc", "content-length": "1", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
51082024-08-16T07:19:21.567ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51092024-08-16T07:19:21.567ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "50b10234-62ee-4dfd-9b4d-f9b7a8a1c151", "date": "Fri, 16 Aug 2024 07:19:21 GMT"} })
51102024-08-16T07:19:21.568ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51112024-08-16T07:19:21.569ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 279.310729ms iteration = 7 status = {}
51122024-08-16T07:19:21.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51132024-08-16T07:19:21.570ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 288.066672ms iteration = 6 status = null
51142024-08-16T07:19:21.595ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 313.459118ms iteration = 6 status = {}
51152024-08-16T07:19:21.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51162024-08-16T07:19:21.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51172024-08-16T07:19:21.667ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
51182024-08-16T07:19:21.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51192024-08-16T07:19:21.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51202024-08-16T07:19:21.673ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51212024-08-16T07:19:21.673ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0ee94dc6-6f0c-49d2-bf23-e8664723df86", "content-length": "121", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
51222024-08-16T07:19:21.673ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
51232024-08-16T07:19:21.673ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
51242024-08-16T07:19:21.674ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
51252024-08-16T07:19:21.674ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
51262024-08-16T07:19:21.674ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
51272024-08-16T07:19:21.674ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
51282024-08-16T07:19:21.674ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
51292024-08-16T07:19:21.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51302024-08-16T07:19:21.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51312024-08-16T07:19:21.675ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51322024-08-16T07:19:21.675ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2253467d-c3c6-4f71-bab4-61145cb2fa25", "content-length": "2", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
51332024-08-16T07:19:21.675ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51342024-08-16T07:19:21.676ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9741bbaf-cfce-466f-aed3-55ff9553ffc5", "content-length": "52", "date": "Fri, 16 Aug 2024 07:19:20 GMT"} })
51352024-08-16T07:19:21.676ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
51362024-08-16T07:19:21.676ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51372024-08-16T07:19:21.727ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c49a2f33-c4e9-456d-a044-c050b25f444e", "date": "Fri, 16 Aug 2024 07:19:21 GMT"} })
51382024-08-16T07:19:21.727ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
51392024-08-16T07:19:21.727ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51402024-08-16T07:19:21.728ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f2f8f48c-de9c-48bc-91fc-e7730d95be26", "content-length": "494", "date": "Fri, 16 Aug 2024 07:19:21 GMT"} })
51412024-08-16T07:19:21.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51422024-08-16T07:19:21.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51432024-08-16T07:19:21.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51442024-08-16T07:19:21.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51452024-08-16T07:19:21.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51462024-08-16T07:19:21.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51472024-08-16T07:19:21.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51482024-08-16T07:19:21.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51492024-08-16T07:19:21.741ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 459.180114ms iteration = 6 status = {}
51502024-08-16T07:19:22.891ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1338 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = fd5a82bd-e153-4e21-87c8-9b0457d8d82b response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
51512024-08-16T07:19:31.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
51522024-08-16T07:19:31.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51532024-08-16T07:19:31.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51542024-08-16T07:19:31.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
51552024-08-16T07:19:31.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
51562024-08-16T07:19:31.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51572024-08-16T07:19:31.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51582024-08-16T07:19:31.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51592024-08-16T07:19:31.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51602024-08-16T07:19:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51612024-08-16T07:19:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51622024-08-16T07:19:31.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51632024-08-16T07:19:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51642024-08-16T07:19:31.287ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
51652024-08-16T07:19:31.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.627134ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51662024-08-16T07:19:31.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51672024-08-16T07:19:31.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51682024-08-16T07:19:31.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51692024-08-16T07:19:31.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
51702024-08-16T07:19:31.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51712024-08-16T07:19:31.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51722024-08-16T07:19:31.297ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
51732024-08-16T07:19:31.297ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.632228ms iteration = 17 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
51742024-08-16T07:19:32.863ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
51752024-08-16T07:19:32.863ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
51762024-08-16T07:19:32.893ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
51772024-08-16T07:19:32.893ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:42003
51782024-08-16T07:19:32.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42003 req_id = b5bb27ae-6ca7-40c7-9270-0425f60290d0 roles = RoleSet { roles: {} } uri = /metrics/producers
51792024-08-16T07:19:32.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42003 req_id = b5bb27ae-6ca7-40c7-9270-0425f60290d0 resource = Database result = Ok(()) uri = /metrics/producers
51802024-08-16T07:19:32.895ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1448 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 8b736a41-2cd4-4d5f-b67e-56288cf8ef25 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
51812024-08-16T07:19:33.008ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
51822024-08-16T07:19:33.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42003 req_id = b5bb27ae-6ca7-40c7-9270-0425f60290d0 roles = RoleSet { roles: {} } uri = /metrics/producers
51832024-08-16T07:19:33.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42003 req_id = b5bb27ae-6ca7-40c7-9270-0425f60290d0 resource = Database result = Ok(()) uri = /metrics/producers
51842024-08-16T07:19:33.015ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
51852024-08-16T07:19:33.016ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "99d2a760-1a87-4fcb-b5a5-c1670ce8018b", "date": "Fri, 16 Aug 2024 07:19:33 GMT"} })
51862024-08-16T07:19:33.016ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
51872024-08-16T07:19:33.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 123970 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42003 req_id = b5bb27ae-6ca7-40c7-9270-0425f60290d0 response_code = 201 uri = /metrics/producers
51882024-08-16T07:19:33.017ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "b5bb27ae-6ca7-40c7-9270-0425f60290d0", "content-length": "41", "date": "Fri, 16 Aug 2024 07:19:32 GMT"} })
51892024-08-16T07:19:33.018ZDEBGnexus (producer-registration-task): registered with nexus successfully
51902024-08-16T07:19:33.018ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
51912024-08-16T07:19:41.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
51922024-08-16T07:19:41.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51932024-08-16T07:19:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51942024-08-16T07:19:41.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51952024-08-16T07:19:41.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
51962024-08-16T07:19:41.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
51972024-08-16T07:19:41.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51982024-08-16T07:19:41.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51992024-08-16T07:19:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52002024-08-16T07:19:41.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52012024-08-16T07:19:41.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52022024-08-16T07:19:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52032024-08-16T07:19:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52042024-08-16T07:19:41.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52052024-08-16T07:19:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52062024-08-16T07:19:41.287ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
52072024-08-16T07:19:41.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.204414ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52082024-08-16T07:19:41.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52092024-08-16T07:19:41.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
52102024-08-16T07:19:41.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52112024-08-16T07:19:41.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52122024-08-16T07:19:41.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
52132024-08-16T07:19:41.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.082156ms iteration = 18 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
52142024-08-16T07:19:43.018ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1491 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = f8d7879a-643d-4a52-a591-d268f7f6f816 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
52152024-08-16T07:19:44.562ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:45393
52162024-08-16T07:19:44.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45393 req_id = 433cbdf0-7e46-447f-b2ec-0c80607873af roles = RoleSet { roles: {} } uri = /metrics/producers
52172024-08-16T07:19:44.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45393 req_id = 433cbdf0-7e46-447f-b2ec-0c80607873af resource = Database result = Ok(()) uri = /metrics/producers
52182024-08-16T07:19:44.594ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
52192024-08-16T07:19:44.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45393 req_id = 433cbdf0-7e46-447f-b2ec-0c80607873af roles = RoleSet { roles: {} } uri = /metrics/producers
52202024-08-16T07:19:44.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45393 req_id = 433cbdf0-7e46-447f-b2ec-0c80607873af resource = Database result = Ok(()) uri = /metrics/producers
52212024-08-16T07:19:44.600ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
52222024-08-16T07:19:44.601ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c4d59496-5bb7-43cb-baf6-e961585d3b5b", "date": "Fri, 16 Aug 2024 07:19:44 GMT"} })
52232024-08-16T07:19:44.601ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
52242024-08-16T07:19:44.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 41058 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45393 req_id = 433cbdf0-7e46-447f-b2ec-0c80607873af response_code = 201 uri = /metrics/producers
52252024-08-16T07:19:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
52262024-08-16T07:19:51.281ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
52272024-08-16T07:19:51.281ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52282024-08-16T07:19:51.281ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
52292024-08-16T07:19:51.282ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:09:51.281916437 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52302024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
52312024-08-16T07:19:51.282ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
52322024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52332024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.981\u{b5}s iteration = 5 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
52342024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
52352024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
52362024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52372024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52382024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52392024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
52402024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
52412024-08-16T07:19:51.282ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
52422024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
52432024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
52442024-08-16T07:19:51.282ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
52452024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
52462024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52472024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52482024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
52492024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52502024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52512024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
52522024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
52532024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
52542024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52552024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
52562024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
52572024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
52582024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52592024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52602024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52612024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
52622024-08-16T07:19:51.282ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
52632024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52642024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
52652024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
52662024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52672024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52682024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52692024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52702024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
52712024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52722024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52732024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52742024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52752024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52762024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52772024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52782024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52792024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52802024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52812024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52822024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52832024-08-16T07:19:51.282ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52842024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52852024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52862024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52872024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52882024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52892024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52902024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52912024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
52922024-08-16T07:19:51.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
52932024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
52942024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52952024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52962024-08-16T07:19:51.283ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 659818880 } })
52972024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52982024-08-16T07:19:51.283ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 659838210 } })
52992024-08-16T07:19:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53002024-08-16T07:19:51.284ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53012024-08-16T07:19:51.284ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:09:51.281916437 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53022024-08-16T07:19:51.284ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.954368ms iteration = 4 status = {"expiration":"2024-08-16T07:09:51.281916437Z","pruned":[]}
53032024-08-16T07:19:51.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53042024-08-16T07:19:51.285ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
53052024-08-16T07:19:51.285ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.078332ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53062024-08-16T07:19:51.285ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
53072024-08-16T07:19:51.285ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.142963ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
53082024-08-16T07:19:51.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53092024-08-16T07:19:51.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53102024-08-16T07:19:51.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53112024-08-16T07:19:51.286ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
53122024-08-16T07:19:51.286ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.427172ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
53132024-08-16T07:19:51.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53142024-08-16T07:19:51.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53152024-08-16T07:19:51.287ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 663434513 } })
53162024-08-16T07:19:51.287ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 663609157 } })
53172024-08-16T07:19:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53182024-08-16T07:19:51.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53192024-08-16T07:19:51.288ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53202024-08-16T07:19:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
53212024-08-16T07:19:51.288ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53222024-08-16T07:19:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53232024-08-16T07:19:51.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
53242024-08-16T07:19:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53252024-08-16T07:19:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53262024-08-16T07:19:51.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
53272024-08-16T07:19:51.289ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
53282024-08-16T07:19:51.289ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
53292024-08-16T07:19:51.289ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53302024-08-16T07:19:51.289ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
53312024-08-16T07:19:51.289ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53322024-08-16T07:19:51.289ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
53332024-08-16T07:19:51.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53342024-08-16T07:19:51.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53352024-08-16T07:19:51.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53362024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53372024-08-16T07:19:51.290ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 666042383 } })
53382024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53392024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53402024-08-16T07:19:51.290ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
53412024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53422024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53432024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53442024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53452024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53462024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53472024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
53482024-08-16T07:19:51.290ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
53492024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53502024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
53512024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
53522024-08-16T07:19:51.290ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
53532024-08-16T07:19:51.290ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
53542024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
53552024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53562024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53572024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53582024-08-16T07:19:51.290ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
53592024-08-16T07:19:51.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 8.953777ms iteration = 7 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
53602024-08-16T07:19:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
53612024-08-16T07:19:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53622024-08-16T07:19:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53632024-08-16T07:19:51.291ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53642024-08-16T07:19:51.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53652024-08-16T07:19:51.291ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
53662024-08-16T07:19:51.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53672024-08-16T07:19:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53682024-08-16T07:19:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53692024-08-16T07:19:51.293ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
53702024-08-16T07:19:51.293ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.405816ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
53712024-08-16T07:19:51.293ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53722024-08-16T07:19:51.293ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
53732024-08-16T07:19:51.293ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
53742024-08-16T07:19:51.293ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
53752024-08-16T07:19:51.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53762024-08-16T07:19:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53772024-08-16T07:19:51.293ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53782024-08-16T07:19:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53792024-08-16T07:19:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53802024-08-16T07:19:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53812024-08-16T07:19:51.294ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53822024-08-16T07:19:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53832024-08-16T07:19:51.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53842024-08-16T07:19:51.294ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53852024-08-16T07:19:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53862024-08-16T07:19:51.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53872024-08-16T07:19:51.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53882024-08-16T07:19:51.294ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53892024-08-16T07:19:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53902024-08-16T07:19:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53912024-08-16T07:19:51.294ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53922024-08-16T07:19:51.295ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53932024-08-16T07:19:51.295ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53942024-08-16T07:19:51.295ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
53952024-08-16T07:19:51.295ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
53962024-08-16T07:19:51.295ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
53972024-08-16T07:19:51.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53982024-08-16T07:19:51.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53992024-08-16T07:19:51.296ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54002024-08-16T07:19:51.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54012024-08-16T07:19:51.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54022024-08-16T07:19:51.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54032024-08-16T07:19:51.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54042024-08-16T07:19:51.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54052024-08-16T07:19:51.297ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54062024-08-16T07:19:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54072024-08-16T07:19:51.297ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54082024-08-16T07:19:51.297ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
54092024-08-16T07:19:51.297ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54102024-08-16T07:19:51.297ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54112024-08-16T07:19:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54122024-08-16T07:19:51.297ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
54132024-08-16T07:19:51.297ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.058015ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54142024-08-16T07:19:51.298ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54152024-08-16T07:19:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54162024-08-16T07:19:51.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54172024-08-16T07:19:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54182024-08-16T07:19:51.298ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54192024-08-16T07:19:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54202024-08-16T07:19:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54212024-08-16T07:19:51.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54222024-08-16T07:19:51.299ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54232024-08-16T07:19:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54242024-08-16T07:19:51.299ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54252024-08-16T07:19:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54262024-08-16T07:19:51.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54272024-08-16T07:19:51.300ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
54282024-08-16T07:19:51.300ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
54292024-08-16T07:19:51.300ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54302024-08-16T07:19:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54312024-08-16T07:19:51.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54322024-08-16T07:19:51.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54332024-08-16T07:19:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54342024-08-16T07:19:51.301ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54352024-08-16T07:19:51.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54362024-08-16T07:19:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54372024-08-16T07:19:51.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54382024-08-16T07:19:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54392024-08-16T07:19:51.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54402024-08-16T07:19:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54412024-08-16T07:19:51.302ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54422024-08-16T07:19:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54432024-08-16T07:19:51.302ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54442024-08-16T07:19:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54452024-08-16T07:19:51.304ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
54462024-08-16T07:19:51.304ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
54472024-08-16T07:19:51.304ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54482024-08-16T07:19:51.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54492024-08-16T07:19:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54502024-08-16T07:19:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54512024-08-16T07:19:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54522024-08-16T07:19:51.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54532024-08-16T07:19:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54542024-08-16T07:19:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54552024-08-16T07:19:51.305ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54562024-08-16T07:19:51.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54572024-08-16T07:19:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54582024-08-16T07:19:51.305ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54592024-08-16T07:19:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
54602024-08-16T07:19:51.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54612024-08-16T07:19:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54622024-08-16T07:19:51.306ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632024-08-16T07:19:51.307ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54642024-08-16T07:19:51.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54652024-08-16T07:19:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54662024-08-16T07:19:51.307ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
54672024-08-16T07:19:51.307ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
54682024-08-16T07:19:51.307ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
54692024-08-16T07:19:51.307ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 25.96251ms iteration = 5 status = {"generation":2}
54702024-08-16T07:19:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54712024-08-16T07:19:51.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54722024-08-16T07:19:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54732024-08-16T07:19:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54742024-08-16T07:19:51.309ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54752024-08-16T07:19:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54762024-08-16T07:19:51.310ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
54772024-08-16T07:19:51.310ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
54782024-08-16T07:19:51.310ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
54792024-08-16T07:19:51.310ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 28.465307ms iteration = 5 status = {"generation":1}
54802024-08-16T07:19:51.311ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54812024-08-16T07:19:51.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54822024-08-16T07:19:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54832024-08-16T07:19:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54842024-08-16T07:19:51.313ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54852024-08-16T07:19:51.313ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
54862024-08-16T07:19:51.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 22.814177ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54872024-08-16T07:19:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54882024-08-16T07:19:51.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54892024-08-16T07:19:51.314ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
54902024-08-16T07:19:51.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54912024-08-16T07:19:51.314ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 32.329006ms iteration = 9 status = {"physical_disks_added":0}
54922024-08-16T07:19:51.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54932024-08-16T07:19:51.316ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 34.460505ms iteration = 3 status = {"nsuccess":5}
54942024-08-16T07:19:51.317ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
54952024-08-16T07:19:51.317ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.655683ms iteration = 19 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
54962024-08-16T07:19:51.318ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
54972024-08-16T07:19:51.318ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
54982024-08-16T07:19:51.318ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 28.803905ms iteration = 4 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
54992024-08-16T07:19:51.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
55002024-08-16T07:19:51.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55012024-08-16T07:19:51.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55022024-08-16T07:19:51.320ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 37.959556ms iteration = 7 status = 0
55032024-08-16T07:19:51.320ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
55042024-08-16T07:19:51.320ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
55052024-08-16T07:19:51.320ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 38.713654ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
55062024-08-16T07:19:51.324ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55072024-08-16T07:19:51.324ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 41.055408ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55082024-08-16T07:19:51.336ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55092024-08-16T07:19:51.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55102024-08-16T07:19:51.342ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
55112024-08-16T07:19:51.342ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55122024-08-16T07:19:51.342ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 52.333488ms iteration = 7 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
55132024-08-16T07:19:51.349ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) }
55142024-08-16T07:19:51.349ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 67.653222ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
55152024-08-16T07:19:51.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55162024-08-16T07:19:51.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55172024-08-16T07:19:51.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55182024-08-16T07:19:51.383ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55192024-08-16T07:19:51.383ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55202024-08-16T07:19:51.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55212024-08-16T07:19:51.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55222024-08-16T07:19:51.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55232024-08-16T07:19:51.387ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55242024-08-16T07:19:51.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55252024-08-16T07:19:51.481ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
55262024-08-16T07:19:51.481ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55272024-08-16T07:19:51.481ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "146d2a2c-ad98-4541-b3d7-7011915d7989", "content-length": "26", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
55282024-08-16T07:19:51.481ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55292024-08-16T07:19:51.483ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55302024-08-16T07:19:51.603ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
55312024-08-16T07:19:51.606ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55322024-08-16T07:19:51.606ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2fa85ec9-2955-4248-a9a9-50f0b58b93be", "content-length": "691", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
55332024-08-16T07:19:51.606ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
55342024-08-16T07:19:51.606ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
55352024-08-16T07:19:51.606ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
55362024-08-16T07:19:51.608ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 325.984829ms iteration = 7 status = {}
55372024-08-16T07:19:51.649ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
55382024-08-16T07:19:51.649ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55392024-08-16T07:19:51.650ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "05485ce6-6462-4119-bab3-186468384ff7", "content-length": "26", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
55402024-08-16T07:19:51.650ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55412024-08-16T07:19:51.652ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55422024-08-16T07:19:51.672ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 389.915955ms iteration = 7 status = {}
55432024-08-16T07:19:51.672ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
55442024-08-16T07:19:51.719ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
55452024-08-16T07:19:51.719ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55462024-08-16T07:19:51.719ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5472f7cb-1d53-4d33-a048-68dba5c98c39", "content-length": "26", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
55472024-08-16T07:19:51.719ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55482024-08-16T07:19:51.720ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
55492024-08-16T07:19:51.755ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55502024-08-16T07:19:51.755ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dd31b7c3-f457-4075-bb23-5e840a57f517", "content-length": "372", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
55512024-08-16T07:19:51.755ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55522024-08-16T07:19:51.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55532024-08-16T07:19:51.756ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
55542024-08-16T07:19:51.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 465.845119ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
55552024-08-16T07:19:51.757ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55562024-08-16T07:19:51.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55572024-08-16T07:19:51.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55582024-08-16T07:19:51.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55592024-08-16T07:19:51.762ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55602024-08-16T07:19:51.762ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "03b11c8b-93f0-4578-a54f-1ede5ab89715", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
55612024-08-16T07:19:51.764ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 474.479758ms iteration = 8 status = {}
55622024-08-16T07:19:51.774ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
55632024-08-16T07:19:51.787ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55642024-08-16T07:19:51.788ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8f9be93f-aa72-427b-ba25-31375853fb4b", "content-length": "1", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
55652024-08-16T07:19:51.789ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55662024-08-16T07:19:51.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55672024-08-16T07:19:51.790ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 508.701258ms iteration = 7 status = null
55682024-08-16T07:19:51.823ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55692024-08-16T07:19:51.823ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "46073b96-d8c5-4c84-8944-830d25ebe351", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55702024-08-16T07:19:51.823ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55712024-08-16T07:19:51.824ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "85fa4b83-ab4f-4dee-b4cd-43dee017ac63", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55722024-08-16T07:19:51.824ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55732024-08-16T07:19:51.826ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55742024-08-16T07:19:51.826ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 544.712291ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55752024-08-16T07:19:51.856ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55762024-08-16T07:19:51.856ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "386d5f1e-2d13-497d-a8c0-68030b79d076", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55772024-08-16T07:19:51.856ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55782024-08-16T07:19:51.858ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "23c8b353-827e-4ca7-87d2-90bd7ef2d026", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55792024-08-16T07:19:51.858ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55802024-08-16T07:19:51.860ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c43682c0-7e15-4b44-92fb-9c9da45219df", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55812024-08-16T07:19:51.860ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55822024-08-16T07:19:51.862ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55832024-08-16T07:19:51.862ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 580.304742ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
55842024-08-16T07:19:51.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55852024-08-16T07:19:51.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55862024-08-16T07:19:51.901ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
55872024-08-16T07:19:51.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55882024-08-16T07:19:51.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55892024-08-16T07:19:51.909ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55902024-08-16T07:19:51.909ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7c1c7a51-73f2-437b-8a23-d5f8f5280ac1", "content-length": "121", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
55912024-08-16T07:19:51.909ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
55922024-08-16T07:19:51.909ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
55932024-08-16T07:19:51.909ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
55942024-08-16T07:19:51.909ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
55952024-08-16T07:19:51.909ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
55962024-08-16T07:19:51.909ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
55972024-08-16T07:19:51.909ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
55982024-08-16T07:19:51.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55992024-08-16T07:19:51.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56002024-08-16T07:19:51.911ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56012024-08-16T07:19:51.911ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dd2995fb-1e48-4ba3-ae83-0a6abf7e74d1", "content-length": "2", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
56022024-08-16T07:19:51.911ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56032024-08-16T07:19:51.911ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "33937b44-ca44-4108-a44d-4e384bc18301", "content-length": "52", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
56042024-08-16T07:19:51.911ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
56052024-08-16T07:19:51.911ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56062024-08-16T07:19:51.981ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "81007ddc-1e3c-445e-924b-64dc511d5616", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
56072024-08-16T07:19:51.981ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
56082024-08-16T07:19:51.981ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56092024-08-16T07:19:51.982ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "31e8b6bc-059e-4c2f-aa67-aaa2ba324c63", "content-length": "494", "date": "Fri, 16 Aug 2024 07:19:51 GMT"} })
56102024-08-16T07:19:51.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56112024-08-16T07:19:51.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56122024-08-16T07:19:51.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56132024-08-16T07:19:51.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56142024-08-16T07:19:51.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56152024-08-16T07:19:51.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56162024-08-16T07:19:51.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56172024-08-16T07:19:51.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56182024-08-16T07:19:51.994ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 712.688299ms iteration = 7 status = {}
56192024-08-16T07:19:53.018ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 8cce6fd8-51b4-4eea-ab57-a7a7eccd64b7 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
56202024-08-16T07:19:53.652ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:50633
56212024-08-16T07:19:53.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50633 req_id = 1d7591f7-2fea-478b-b248-045ae4516f2b roles = RoleSet { roles: {} } uri = /metrics/producers
56222024-08-16T07:19:53.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50633 req_id = 1d7591f7-2fea-478b-b248-045ae4516f2b resource = Database result = Ok(()) uri = /metrics/producers
56232024-08-16T07:19:53.685ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
56242024-08-16T07:19:53.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50633 req_id = 1d7591f7-2fea-478b-b248-045ae4516f2b roles = RoleSet { roles: {} } uri = /metrics/producers
56252024-08-16T07:19:53.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50633 req_id = 1d7591f7-2fea-478b-b248-045ae4516f2b resource = Database result = Ok(()) uri = /metrics/producers
56262024-08-16T07:19:53.715ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
56272024-08-16T07:19:53.716ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e2da69b5-8c46-44a5-8aac-245c6c0a80b6", "date": "Fri, 16 Aug 2024 07:19:53 GMT"} })
56282024-08-16T07:19:53.716ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 48a86640-720d-4ca7-a9c7-97a8f5a86939
56292024-08-16T07:19:53.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 64864 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50633 req_id = 1d7591f7-2fea-478b-b248-045ae4516f2b response_code = 201 uri = /metrics/producers
56302024-08-16T07:20:01.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
56312024-08-16T07:20:01.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56322024-08-16T07:20:01.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56332024-08-16T07:20:01.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56342024-08-16T07:20:01.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
56352024-08-16T07:20:01.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
56362024-08-16T07:20:01.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56372024-08-16T07:20:01.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56382024-08-16T07:20:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56392024-08-16T07:20:01.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56402024-08-16T07:20:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56412024-08-16T07:20:01.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56422024-08-16T07:20:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56432024-08-16T07:20:01.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56442024-08-16T07:20:01.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56452024-08-16T07:20:01.287ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
56462024-08-16T07:20:01.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.905367ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56472024-08-16T07:20:01.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56482024-08-16T07:20:01.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
56492024-08-16T07:20:01.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56502024-08-16T07:20:01.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56512024-08-16T07:20:01.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
56522024-08-16T07:20:01.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.72673ms iteration = 20 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
56532024-08-16T07:20:02.341ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43482
56542024-08-16T07:20:02.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43482 req_id = 881f462b-0db1-4d06-bc4c-37b768c21c28 roles = RoleSet { roles: {} } uri = /metrics/producers
56552024-08-16T07:20:02.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43482 req_id = 881f462b-0db1-4d06-bc4c-37b768c21c28 resource = Database result = Ok(()) uri = /metrics/producers
56562024-08-16T07:20:02.373ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
56572024-08-16T07:20:02.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43482 req_id = 881f462b-0db1-4d06-bc4c-37b768c21c28 roles = RoleSet { roles: {} } uri = /metrics/producers
56582024-08-16T07:20:02.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43482 req_id = 881f462b-0db1-4d06-bc4c-37b768c21c28 resource = Database result = Ok(()) uri = /metrics/producers
56592024-08-16T07:20:02.380ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
56602024-08-16T07:20:02.381ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5ec6ede4-e127-4d62-8988-28d54ebe3351", "date": "Fri, 16 Aug 2024 07:20:02 GMT"} })
56612024-08-16T07:20:02.381ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 89fb4a58-54f1-4b77-bc54-dd764b735a68
56622024-08-16T07:20:02.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 41421 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43482 req_id = 881f462b-0db1-4d06-bc4c-37b768c21c28 response_code = 201 uri = /metrics/producers
56632024-08-16T07:20:03.018ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1880 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 7e8b21c1-6a60-4203-bcf1-1981ce1fc694 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
56642024-08-16T07:20:11.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
56652024-08-16T07:20:11.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56662024-08-16T07:20:11.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56672024-08-16T07:20:11.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56682024-08-16T07:20:11.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
56692024-08-16T07:20:11.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
56702024-08-16T07:20:11.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56712024-08-16T07:20:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56722024-08-16T07:20:11.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56732024-08-16T07:20:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56742024-08-16T07:20:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56752024-08-16T07:20:11.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56762024-08-16T07:20:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56772024-08-16T07:20:11.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56782024-08-16T07:20:11.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56792024-08-16T07:20:11.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56802024-08-16T07:20:11.289ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
56812024-08-16T07:20:11.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.482057ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56822024-08-16T07:20:11.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
56832024-08-16T07:20:11.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56842024-08-16T07:20:11.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56852024-08-16T07:20:11.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
56862024-08-16T07:20:11.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.737471ms iteration = 21 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
56872024-08-16T07:20:13.019ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 31a1a5d9-8beb-4c28-bbb4-c36182ed7336 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
56882024-08-16T07:20:17.012ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:64147
56892024-08-16T07:20:17.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64147 req_id = 41bd77eb-355a-424a-87d5-e3e3baeb20f0 roles = RoleSet { roles: {} } uri = /metrics/producers
56902024-08-16T07:20:17.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64147 req_id = 41bd77eb-355a-424a-87d5-e3e3baeb20f0 resource = Database result = Ok(()) uri = /metrics/producers
56912024-08-16T07:20:17.046ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
56922024-08-16T07:20:17.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64147 req_id = 41bd77eb-355a-424a-87d5-e3e3baeb20f0 roles = RoleSet { roles: {} } uri = /metrics/producers
56932024-08-16T07:20:17.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64147 req_id = 41bd77eb-355a-424a-87d5-e3e3baeb20f0 resource = Database result = Ok(()) uri = /metrics/producers
56942024-08-16T07:20:17.052ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
56952024-08-16T07:20:17.052ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7956bd15-b179-46b1-8a21-d52e0f6ecfca", "date": "Fri, 16 Aug 2024 07:20:17 GMT"} })
56962024-08-16T07:20:17.052ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 911a2faf-c618-4671-9845-24941ebe21a2
56972024-08-16T07:20:17.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 39961 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64147 req_id = 41bd77eb-355a-424a-87d5-e3e3baeb20f0 response_code = 201 uri = /metrics/producers
56982024-08-16T07:20:21.281ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
56992024-08-16T07:20:21.281ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57002024-08-16T07:20:21.281ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
57012024-08-16T07:20:21.281ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
57022024-08-16T07:20:21.281ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57032024-08-16T07:20:21.281ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
57042024-08-16T07:20:21.281ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
57052024-08-16T07:20:21.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57062024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57072024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
57082024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57092024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
57102024-08-16T07:20:21.282ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
57112024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
57122024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
57132024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57142024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
57152024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57162024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57172024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57182024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57192024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57202024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57212024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57222024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57232024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57242024-08-16T07:20:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57252024-08-16T07:20:21.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57262024-08-16T07:20:21.284ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
57272024-08-16T07:20:21.284ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
57282024-08-16T07:20:21.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57292024-08-16T07:20:21.284ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
57302024-08-16T07:20:21.284ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57312024-08-16T07:20:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57322024-08-16T07:20:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57332024-08-16T07:20:21.284ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1284, tv_nsec: 660681787 } })
57342024-08-16T07:20:21.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57352024-08-16T07:20:21.284ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1284, tv_nsec: 660829950 } })
57362024-08-16T07:20:21.284ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57372024-08-16T07:20:21.285ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57382024-08-16T07:20:21.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57392024-08-16T07:20:21.285ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
57402024-08-16T07:20:21.285ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.548562ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57412024-08-16T07:20:21.285ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
57422024-08-16T07:20:21.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57432024-08-16T07:20:21.286ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
57442024-08-16T07:20:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57452024-08-16T07:20:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57462024-08-16T07:20:21.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57472024-08-16T07:20:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57482024-08-16T07:20:21.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57492024-08-16T07:20:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57502024-08-16T07:20:21.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57512024-08-16T07:20:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57522024-08-16T07:20:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57532024-08-16T07:20:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57542024-08-16T07:20:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57552024-08-16T07:20:21.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57562024-08-16T07:20:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57572024-08-16T07:20:21.289ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
57582024-08-16T07:20:21.289ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
57592024-08-16T07:20:21.289ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57602024-08-16T07:20:21.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57612024-08-16T07:20:21.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57622024-08-16T07:20:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57632024-08-16T07:20:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57642024-08-16T07:20:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57652024-08-16T07:20:21.290ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57662024-08-16T07:20:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57672024-08-16T07:20:21.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57682024-08-16T07:20:21.290ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
57692024-08-16T07:20:21.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.775166ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57702024-08-16T07:20:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57712024-08-16T07:20:21.290ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
57722024-08-16T07:20:21.290ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
57732024-08-16T07:20:21.290ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
57742024-08-16T07:20:21.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57752024-08-16T07:20:21.291ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
57762024-08-16T07:20:21.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57772024-08-16T07:20:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57782024-08-16T07:20:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57792024-08-16T07:20:21.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57802024-08-16T07:20:21.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57812024-08-16T07:20:21.294ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
57822024-08-16T07:20:21.294ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57832024-08-16T07:20:21.294ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57842024-08-16T07:20:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57852024-08-16T07:20:21.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57862024-08-16T07:20:21.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57872024-08-16T07:20:21.295ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
57882024-08-16T07:20:21.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57892024-08-16T07:20:21.295ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57902024-08-16T07:20:21.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57912024-08-16T07:20:21.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57922024-08-16T07:20:21.297ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1284, tv_nsec: 673414530 } })
57932024-08-16T07:20:21.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
57942024-08-16T07:20:21.297ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57952024-08-16T07:20:21.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57962024-08-16T07:20:21.297ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57972024-08-16T07:20:21.297ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57982024-08-16T07:20:21.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57992024-08-16T07:20:21.298ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
58002024-08-16T07:20:21.299ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
58012024-08-16T07:20:21.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.567608ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
58022024-08-16T07:20:21.300ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58032024-08-16T07:20:21.300ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58042024-08-16T07:20:21.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58052024-08-16T07:20:21.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58062024-08-16T07:20:21.300ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58072024-08-16T07:20:21.300ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58082024-08-16T07:20:21.300ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 16.315407ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58092024-08-16T07:20:21.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58102024-08-16T07:20:21.301ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58112024-08-16T07:20:21.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58122024-08-16T07:20:21.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58132024-08-16T07:20:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58142024-08-16T07:20:21.302ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
58152024-08-16T07:20:21.303ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.037378ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
58162024-08-16T07:20:21.304ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
58172024-08-16T07:20:21.304ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.178192ms iteration = 22 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
58182024-08-16T07:20:21.307ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
58192024-08-16T07:20:21.307ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 25.393906ms iteration = 10 status = {"physical_disks_added":0}
58202024-08-16T07:20:21.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58212024-08-16T07:20:21.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58222024-08-16T07:20:21.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58232024-08-16T07:20:21.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58242024-08-16T07:20:21.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58252024-08-16T07:20:21.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58262024-08-16T07:20:21.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58272024-08-16T07:20:21.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58282024-08-16T07:20:21.314ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58292024-08-16T07:20:21.314ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58302024-08-16T07:20:21.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58312024-08-16T07:20:21.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58322024-08-16T07:20:21.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
58332024-08-16T07:20:21.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58342024-08-16T07:20:21.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58352024-08-16T07:20:21.316ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58362024-08-16T07:20:21.316ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58372024-08-16T07:20:21.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58382024-08-16T07:20:21.317ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 35.831417ms iteration = 8 status = 0
58392024-08-16T07:20:21.325ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
58402024-08-16T07:20:21.325ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58412024-08-16T07:20:21.325ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 35.977491ms iteration = 8 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
58422024-08-16T07:20:21.325ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58432024-08-16T07:20:21.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58442024-08-16T07:20:21.327ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
58452024-08-16T07:20:21.327ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 45.733447ms iteration = 8 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
58462024-08-16T07:20:21.403ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
58472024-08-16T07:20:21.404ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58482024-08-16T07:20:21.404ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "74dd1046-4dc2-44b2-85a8-08e568522245", "content-length": "26", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
58492024-08-16T07:20:21.404ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58502024-08-16T07:20:21.406ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58512024-08-16T07:20:21.419ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
58522024-08-16T07:20:21.419ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58532024-08-16T07:20:21.420ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e731b643-0a73-4615-a60b-50be62cb7bce", "content-length": "26", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
58542024-08-16T07:20:21.420ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58552024-08-16T07:20:21.422ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58562024-08-16T07:20:21.547ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 265.408359ms iteration = 8 status = {}
58572024-08-16T07:20:21.559ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58582024-08-16T07:20:21.559ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d43d238c-0995-4547-996e-577185598dd0", "content-length": "1", "date": "Fri, 16 Aug 2024 07:20:20 GMT"} })
58592024-08-16T07:20:21.561ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58602024-08-16T07:20:21.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58612024-08-16T07:20:21.563ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 281.274276ms iteration = 8 status = null
58622024-08-16T07:20:21.606ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
58632024-08-16T07:20:21.606ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58642024-08-16T07:20:21.606ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "62382693-b48e-4732-8ca2-04d48f6c3bd2", "content-length": "26", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
58652024-08-16T07:20:21.606ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58662024-08-16T07:20:21.608ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
58672024-08-16T07:20:21.633ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58682024-08-16T07:20:21.633ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dee3d841-c186-4375-b58a-0823a67d01b7", "content-length": "691", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
58692024-08-16T07:20:21.633ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
58702024-08-16T07:20:21.633ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
58712024-08-16T07:20:21.633ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
58722024-08-16T07:20:21.635ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 353.893934ms iteration = 8 status = {}
58732024-08-16T07:20:21.638ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58742024-08-16T07:20:21.638ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "06c5c9ef-21d8-4b9b-a9bc-66a708f4c356", "content-length": "372", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
58752024-08-16T07:20:21.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58762024-08-16T07:20:21.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58772024-08-16T07:20:21.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58782024-08-16T07:20:21.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58792024-08-16T07:20:21.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58802024-08-16T07:20:21.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58812024-08-16T07:20:21.645ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58822024-08-16T07:20:21.646ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b4e5e63c-00a8-47a1-aad9-d50a856aa8ed", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
58832024-08-16T07:20:21.647ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 358.051469ms iteration = 9 status = {}
58842024-08-16T07:20:21.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58852024-08-16T07:20:21.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58862024-08-16T07:20:21.720ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
58872024-08-16T07:20:21.720ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58882024-08-16T07:20:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58892024-08-16T07:20:21.727ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
58902024-08-16T07:20:21.727ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "279b4f1f-ecc4-4f3d-b855-dcfaadb981f0", "content-length": "121", "date": "Fri, 16 Aug 2024 07:20:20 GMT"} })
58912024-08-16T07:20:21.727ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
58922024-08-16T07:20:21.727ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
58932024-08-16T07:20:21.727ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
58942024-08-16T07:20:21.727ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
58952024-08-16T07:20:21.727ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
58962024-08-16T07:20:21.727ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
58972024-08-16T07:20:21.727ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
58982024-08-16T07:20:21.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58992024-08-16T07:20:21.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59002024-08-16T07:20:21.729ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59012024-08-16T07:20:21.730ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "babf1c6a-0cd6-4357-ac55-fc5c94109df1", "content-length": "2", "date": "Fri, 16 Aug 2024 07:20:20 GMT"} })
59022024-08-16T07:20:21.730ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59032024-08-16T07:20:21.730ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "beaa86e4-55c9-4671-b2c6-2982ba2e3e2d", "content-length": "52", "date": "Fri, 16 Aug 2024 07:20:20 GMT"} })
59042024-08-16T07:20:21.730ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
59052024-08-16T07:20:21.730ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59062024-08-16T07:20:21.802ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f71bf366-f1da-432c-a97e-d472fd63ea98", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
59072024-08-16T07:20:21.802ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
59082024-08-16T07:20:21.802ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59092024-08-16T07:20:21.802ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0d18fba7-e5ff-4630-8229-37bd172712bc", "content-length": "494", "date": "Fri, 16 Aug 2024 07:20:21 GMT"} })
59102024-08-16T07:20:21.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59112024-08-16T07:20:21.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59122024-08-16T07:20:21.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59132024-08-16T07:20:21.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59142024-08-16T07:20:21.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59152024-08-16T07:20:21.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59162024-08-16T07:20:21.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59172024-08-16T07:20:21.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59182024-08-16T07:20:21.815ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 533.910771ms iteration = 8 status = {}
59192024-08-16T07:20:22.545ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48132
59202024-08-16T07:20:22.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48132 req_id = ac38690a-57c9-450d-b35d-b1e349a27121 roles = RoleSet { roles: {} } uri = /metrics/producers
59212024-08-16T07:20:22.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48132 req_id = ac38690a-57c9-450d-b35d-b1e349a27121 resource = Database result = Ok(()) uri = /metrics/producers
59222024-08-16T07:20:22.578ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
59232024-08-16T07:20:22.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48132 req_id = ac38690a-57c9-450d-b35d-b1e349a27121 roles = RoleSet { roles: {} } uri = /metrics/producers
59242024-08-16T07:20:22.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48132 req_id = ac38690a-57c9-450d-b35d-b1e349a27121 resource = Database result = Ok(()) uri = /metrics/producers
59252024-08-16T07:20:22.584ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
59262024-08-16T07:20:22.585ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2ab9b8d5-c274-4a31-b74f-1e7eb064800c", "date": "Fri, 16 Aug 2024 07:20:22 GMT"} })
59272024-08-16T07:20:22.585ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = b9b5cfb7-1d99-4535-948c-195d99b3bf69
59282024-08-16T07:20:22.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 40726 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48132 req_id = ac38690a-57c9-450d-b35d-b1e349a27121 response_code = 201 uri = /metrics/producers
59292024-08-16T07:20:23.018ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1295 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 46b9f2a8-c358-400e-994a-9a250d433aa2 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
59302024-08-16T07:20:31.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
59312024-08-16T07:20:31.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59322024-08-16T07:20:31.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59332024-08-16T07:20:31.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
59342024-08-16T07:20:31.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
59352024-08-16T07:20:31.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59362024-08-16T07:20:31.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59372024-08-16T07:20:31.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59382024-08-16T07:20:31.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59392024-08-16T07:20:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59402024-08-16T07:20:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59412024-08-16T07:20:31.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59422024-08-16T07:20:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59432024-08-16T07:20:31.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
59442024-08-16T07:20:31.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.972279ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59452024-08-16T07:20:31.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59462024-08-16T07:20:31.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59472024-08-16T07:20:31.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59482024-08-16T07:20:31.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
59492024-08-16T07:20:31.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59502024-08-16T07:20:31.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59512024-08-16T07:20:31.298ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
59522024-08-16T07:20:31.298ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.584733ms iteration = 23 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
59532024-08-16T07:20:33.018ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 3c7d4f92-a3db-4960-a7a3-35241e5dfa54 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
59542024-08-16T07:20:41.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
59552024-08-16T07:20:41.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59562024-08-16T07:20:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59572024-08-16T07:20:41.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
59582024-08-16T07:20:41.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
59592024-08-16T07:20:41.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59602024-08-16T07:20:41.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59612024-08-16T07:20:41.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59622024-08-16T07:20:41.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59632024-08-16T07:20:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59642024-08-16T07:20:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59652024-08-16T07:20:41.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59662024-08-16T07:20:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59672024-08-16T07:20:41.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
59682024-08-16T07:20:41.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.869806ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59692024-08-16T07:20:41.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59702024-08-16T07:20:41.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59712024-08-16T07:20:41.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59722024-08-16T07:20:41.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
59732024-08-16T07:20:41.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59742024-08-16T07:20:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59752024-08-16T07:20:41.298ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
59762024-08-16T07:20:41.298ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.88279ms iteration = 24 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
59772024-08-16T07:20:43.018ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1691 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 231cee86-3af7-4777-9467-c3bfc2b1d0d5 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
59782024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
59792024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
59802024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59812024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
59822024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59832024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
59842024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59852024-08-16T07:20:51.282ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
59862024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
59872024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
59882024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59892024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
59902024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
59912024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59922024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59932024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
59942024-08-16T07:20:51.282ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
59952024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59962024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
59972024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59982024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
59992024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
60002024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
60012024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60022024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
60032024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
60042024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
60052024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60062024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
60072024-08-16T07:20:51.282ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
60082024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
60092024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
60102024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
60112024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.59\u{b5}s iteration = 6 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
60122024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60132024-08-16T07:20:51.282ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:10:51.282534609 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
60142024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
60152024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
60162024-08-16T07:20:51.282ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
60172024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60182024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60192024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60202024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60212024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60222024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60232024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60242024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60252024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60262024-08-16T07:20:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60272024-08-16T07:20:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60282024-08-16T07:20:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60292024-08-16T07:20:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60302024-08-16T07:20:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
60312024-08-16T07:20:51.283ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 659369400 } })
60322024-08-16T07:20:51.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
60332024-08-16T07:20:51.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
60342024-08-16T07:20:51.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60352024-08-16T07:20:51.283ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
60362024-08-16T07:20:51.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60372024-08-16T07:20:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60382024-08-16T07:20:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60392024-08-16T07:20:51.284ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60402024-08-16T07:20:51.284ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60412024-08-16T07:20:51.285ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 661341486 } })
60422024-08-16T07:20:51.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60432024-08-16T07:20:51.285ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
60442024-08-16T07:20:51.285ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.628743ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60452024-08-16T07:20:51.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60462024-08-16T07:20:51.286ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
60472024-08-16T07:20:51.286ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.947661ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
60482024-08-16T07:20:51.286ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60492024-08-16T07:20:51.286ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60502024-08-16T07:20:51.286ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60512024-08-16T07:20:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60522024-08-16T07:20:51.287ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60532024-08-16T07:20:51.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60542024-08-16T07:20:51.287ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 664100399 } })
60552024-08-16T07:20:51.287ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
60562024-08-16T07:20:51.287ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.406465ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
60572024-08-16T07:20:51.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60582024-08-16T07:20:51.287ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60592024-08-16T07:20:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60602024-08-16T07:20:51.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60612024-08-16T07:20:51.288ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 664271183 } })
60622024-08-16T07:20:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60632024-08-16T07:20:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60642024-08-16T07:20:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60652024-08-16T07:20:51.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60662024-08-16T07:20:51.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60672024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60682024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60692024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60702024-08-16T07:20:51.289ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
60712024-08-16T07:20:51.289ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
60722024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
60732024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
60742024-08-16T07:20:51.289ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
60752024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60762024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60772024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
60782024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
60792024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60802024-08-16T07:20:51.289ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
60812024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60822024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
60832024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60842024-08-16T07:20:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60852024-08-16T07:20:51.290ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60862024-08-16T07:20:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60872024-08-16T07:20:51.290ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60882024-08-16T07:20:51.290ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
60892024-08-16T07:20:51.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.860099ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60902024-08-16T07:20:51.290ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60912024-08-16T07:20:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60922024-08-16T07:20:51.290ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
60932024-08-16T07:20:51.290ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
60942024-08-16T07:20:51.290ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
60952024-08-16T07:20:51.290ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
60962024-08-16T07:20:51.290ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60972024-08-16T07:20:51.290ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
60982024-08-16T07:20:51.290ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
60992024-08-16T07:20:51.290ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
61002024-08-16T07:20:51.290ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61012024-08-16T07:20:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61022024-08-16T07:20:51.291ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61032024-08-16T07:20:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61042024-08-16T07:20:51.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61052024-08-16T07:20:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
61062024-08-16T07:20:51.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61072024-08-16T07:20:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61082024-08-16T07:20:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61092024-08-16T07:20:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61102024-08-16T07:20:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61112024-08-16T07:20:51.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61122024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61132024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61142024-08-16T07:20:51.292ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
61152024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61162024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61172024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61182024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61192024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
61202024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61212024-08-16T07:20:51.292ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
61222024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61232024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 3.001319ms iteration = 5 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
61242024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61252024-08-16T07:20:51.292ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
61262024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 10.267577ms iteration = 9 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
61272024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61282024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61292024-08-16T07:20:51.292ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
61302024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.015627ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
61312024-08-16T07:20:51.292ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
61322024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.059977ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
61332024-08-16T07:20:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61342024-08-16T07:20:51.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61352024-08-16T07:20:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61362024-08-16T07:20:51.294ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:10:51.282534609 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
61372024-08-16T07:20:51.294ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.579137ms iteration = 5 status = {"expiration":"2024-08-16T07:10:51.282534609Z","pruned":[]}
61382024-08-16T07:20:51.294ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61392024-08-16T07:20:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61402024-08-16T07:20:51.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61412024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61422024-08-16T07:20:51.295ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
61432024-08-16T07:20:51.295ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61442024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 5.875936ms iteration = 9 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
61452024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61462024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61472024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61482024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61492024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
61502024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61512024-08-16T07:20:51.295ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 671989452 } })
61522024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61532024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61542024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61552024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61562024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61572024-08-16T07:20:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61582024-08-16T07:20:51.296ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
61592024-08-16T07:20:51.296ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
61602024-08-16T07:20:51.296ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
61612024-08-16T07:20:51.296ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61622024-08-16T07:20:51.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61632024-08-16T07:20:51.296ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
61642024-08-16T07:20:51.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.123292ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
61652024-08-16T07:20:51.296ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61662024-08-16T07:20:51.296ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61672024-08-16T07:20:51.296ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
61682024-08-16T07:20:51.296ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61692024-08-16T07:20:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61702024-08-16T07:20:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61712024-08-16T07:20:51.297ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
61722024-08-16T07:20:51.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61732024-08-16T07:20:51.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61742024-08-16T07:20:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
61752024-08-16T07:20:51.298ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61762024-08-16T07:20:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61772024-08-16T07:20:51.298ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61782024-08-16T07:20:51.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61792024-08-16T07:20:51.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61802024-08-16T07:20:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61812024-08-16T07:20:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61822024-08-16T07:20:51.299ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61832024-08-16T07:20:51.299ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 16.47002ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61842024-08-16T07:20:51.300ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61852024-08-16T07:20:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61862024-08-16T07:20:51.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61872024-08-16T07:20:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61882024-08-16T07:20:51.302ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61892024-08-16T07:20:51.302ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61902024-08-16T07:20:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61912024-08-16T07:20:51.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61922024-08-16T07:20:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61932024-08-16T07:20:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61942024-08-16T07:20:51.303ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
61952024-08-16T07:20:51.303ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
61962024-08-16T07:20:51.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61972024-08-16T07:20:51.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61982024-08-16T07:20:51.304ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
61992024-08-16T07:20:51.304ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
62002024-08-16T07:20:51.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62012024-08-16T07:20:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62022024-08-16T07:20:51.304ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
62032024-08-16T07:20:51.304ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.248644ms iteration = 25 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
62042024-08-16T07:20:51.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62052024-08-16T07:20:51.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62062024-08-16T07:20:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62072024-08-16T07:20:51.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62082024-08-16T07:20:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62092024-08-16T07:20:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62102024-08-16T07:20:51.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62112024-08-16T07:20:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62122024-08-16T07:20:51.309ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
62132024-08-16T07:20:51.309ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62142024-08-16T07:20:51.309ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
62152024-08-16T07:20:51.309ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 27.329461ms iteration = 6 status = {"generation":1}
62162024-08-16T07:20:51.309ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
62172024-08-16T07:20:51.309ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62182024-08-16T07:20:51.309ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
62192024-08-16T07:20:51.309ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 27.269099ms iteration = 6 status = {"generation":2}
62202024-08-16T07:20:51.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62212024-08-16T07:20:51.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62222024-08-16T07:20:51.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62232024-08-16T07:20:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62242024-08-16T07:20:51.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62252024-08-16T07:20:51.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
62262024-08-16T07:20:51.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62272024-08-16T07:20:51.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62282024-08-16T07:20:51.317ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 35.09051ms iteration = 9 status = 0
62292024-08-16T07:20:51.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62302024-08-16T07:20:51.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62312024-08-16T07:20:51.330ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
62322024-08-16T07:20:51.330ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 48.126481ms iteration = 11 status = {"physical_disks_added":0}
62332024-08-16T07:20:51.331ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
62342024-08-16T07:20:51.331ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
62352024-08-16T07:20:51.331ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 48.705845ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
62362024-08-16T07:20:51.341ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) }
62372024-08-16T07:20:51.341ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 59.252878ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
62382024-08-16T07:20:51.359ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62392024-08-16T07:20:51.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62402024-08-16T07:20:51.360ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62412024-08-16T07:20:51.362ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62422024-08-16T07:20:51.362ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62432024-08-16T07:20:51.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62442024-08-16T07:20:51.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62452024-08-16T07:20:51.365ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62462024-08-16T07:20:51.365ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62472024-08-16T07:20:51.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62482024-08-16T07:20:51.440ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
62492024-08-16T07:20:51.499ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
62502024-08-16T07:20:51.526ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
62512024-08-16T07:20:51.526ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62522024-08-16T07:20:51.527ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "951ebc10-5263-493c-b480-9cf9e3593b6a", "content-length": "26", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
62532024-08-16T07:20:51.527ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62542024-08-16T07:20:51.529ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
62552024-08-16T07:20:51.620ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
62562024-08-16T07:20:51.620ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62572024-08-16T07:20:51.621ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a2f182af-9d20-4436-b4ca-1616e8b64b57", "content-length": "26", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
62582024-08-16T07:20:51.621ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62592024-08-16T07:20:51.623ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62602024-08-16T07:20:51.627ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62612024-08-16T07:20:51.641ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
62622024-08-16T07:20:51.641ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62632024-08-16T07:20:51.641ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f8654b05-5a97-4b1a-ba00-6e91373c5477", "content-length": "26", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
62642024-08-16T07:20:51.641ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62652024-08-16T07:20:51.643ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62662024-08-16T07:20:51.673ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62672024-08-16T07:20:51.699ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62682024-08-16T07:20:51.699ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cc45434d-09f0-4d9d-8273-3bdc31280299", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62692024-08-16T07:20:51.699ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62702024-08-16T07:20:51.701ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "926bde27-8944-4e23-8cf3-290b0fe96111", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62712024-08-16T07:20:51.701ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62722024-08-16T07:20:51.703ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62732024-08-16T07:20:51.703ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 420.747186ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
62742024-08-16T07:20:51.707ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6a314ae4-b849-448d-8ac4-eb4a70322e88", "content-length": "372", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
62752024-08-16T07:20:51.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62762024-08-16T07:20:51.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62772024-08-16T07:20:51.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62782024-08-16T07:20:51.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62792024-08-16T07:20:51.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62802024-08-16T07:20:51.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62812024-08-16T07:20:51.716ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62822024-08-16T07:20:51.717ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0e1bc21b-0287-4b64-a94f-6df97540d784", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
62832024-08-16T07:20:51.722ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 433.372308ms iteration = 10 status = {}
62842024-08-16T07:20:51.768ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62852024-08-16T07:20:51.768ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9256f676-c500-4660-a601-b474de40e645", "content-length": "691", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
62862024-08-16T07:20:51.768ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
62872024-08-16T07:20:51.768ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
62882024-08-16T07:20:51.768ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
62892024-08-16T07:20:51.770ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 487.624531ms iteration = 9 status = {}
62902024-08-16T07:20:51.774ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
62912024-08-16T07:20:51.774ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5ff38c09-1cdb-4830-bd09-bb59afd915ac", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62922024-08-16T07:20:51.774ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62932024-08-16T07:20:51.776ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8aa9a7aa-ed34-45bd-b23e-d0b2e13e15d8", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62942024-08-16T07:20:51.776ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62952024-08-16T07:20:51.778ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ef70724f-e4e3-4b11-91f6-f82478cf7130", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62962024-08-16T07:20:51.778ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62972024-08-16T07:20:51.780ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62982024-08-16T07:20:51.780ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "148b5e3b-c595-45a5-ba5d-f234e553a7ba", "content-length": "1", "date": "Fri, 16 Aug 2024 07:20:50 GMT"} })
62992024-08-16T07:20:51.780ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
63002024-08-16T07:20:51.780ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 498.39451ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
63012024-08-16T07:20:51.781ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63022024-08-16T07:20:51.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63032024-08-16T07:20:51.783ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 500.677902ms iteration = 9 status = null
63042024-08-16T07:20:51.785ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 503.443966ms iteration = 9 status = {}
63052024-08-16T07:20:51.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63062024-08-16T07:20:51.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63072024-08-16T07:20:51.859ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
63082024-08-16T07:20:51.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63092024-08-16T07:20:51.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63102024-08-16T07:20:51.868ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63112024-08-16T07:20:51.868ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "99b5f173-84d7-42a2-8abe-e43ebde8ad7d", "content-length": "121", "date": "Fri, 16 Aug 2024 07:20:50 GMT"} })
63122024-08-16T07:20:51.868ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
63132024-08-16T07:20:51.868ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
63142024-08-16T07:20:51.868ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
63152024-08-16T07:20:51.868ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
63162024-08-16T07:20:51.868ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
63172024-08-16T07:20:51.868ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
63182024-08-16T07:20:51.868ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
63192024-08-16T07:20:51.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63202024-08-16T07:20:51.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63212024-08-16T07:20:51.870ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63222024-08-16T07:20:51.870ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "116a28e2-4e91-4007-80b1-0ea6a9294095", "content-length": "2", "date": "Fri, 16 Aug 2024 07:20:50 GMT"} })
63232024-08-16T07:20:51.870ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63242024-08-16T07:20:51.870ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b4cd27e6-2b0e-4d32-9e90-e617b6b05e73", "content-length": "52", "date": "Fri, 16 Aug 2024 07:20:50 GMT"} })
63252024-08-16T07:20:51.870ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
63262024-08-16T07:20:51.870ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63272024-08-16T07:20:51.921ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1bac1074-5e2d-473b-a41b-3ce9a1193f5e", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
63282024-08-16T07:20:51.921ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
63292024-08-16T07:20:51.921ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63302024-08-16T07:20:51.922ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "60ec0bda-a970-4b73-bb05-a8cbf7451063", "content-length": "494", "date": "Fri, 16 Aug 2024 07:20:51 GMT"} })
63312024-08-16T07:20:51.922ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63322024-08-16T07:20:51.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63332024-08-16T07:20:51.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63342024-08-16T07:20:51.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63352024-08-16T07:20:51.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63362024-08-16T07:20:51.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63372024-08-16T07:20:51.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63382024-08-16T07:20:51.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63392024-08-16T07:20:51.935ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 653.583094ms iteration = 9 status = {}
63402024-08-16T07:20:53.018ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1569 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 7745983c-9d5e-4ef5-ac9c-e4e26203514c response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
63412024-08-16T07:21:01.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
63422024-08-16T07:21:01.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63432024-08-16T07:21:01.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63442024-08-16T07:21:01.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
63452024-08-16T07:21:01.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
63462024-08-16T07:21:01.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63472024-08-16T07:21:01.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63482024-08-16T07:21:01.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63492024-08-16T07:21:01.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63502024-08-16T07:21:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63512024-08-16T07:21:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63522024-08-16T07:21:01.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63532024-08-16T07:21:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63542024-08-16T07:21:01.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63552024-08-16T07:21:01.287ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
63562024-08-16T07:21:01.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.544282ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63572024-08-16T07:21:01.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63582024-08-16T07:21:01.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63592024-08-16T07:21:01.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
63602024-08-16T07:21:01.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63612024-08-16T07:21:01.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63622024-08-16T07:21:01.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
63632024-08-16T07:21:01.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.579127ms iteration = 26 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
63642024-08-16T07:21:03.018ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1758 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 3b48c0d9-7c17-4cc4-b881-0f31e02f8898 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
63652024-08-16T07:21:11.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
63662024-08-16T07:21:11.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63672024-08-16T07:21:11.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63682024-08-16T07:21:11.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63692024-08-16T07:21:11.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
63702024-08-16T07:21:11.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
63712024-08-16T07:21:11.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63722024-08-16T07:21:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63732024-08-16T07:21:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63742024-08-16T07:21:11.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63752024-08-16T07:21:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63762024-08-16T07:21:11.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63772024-08-16T07:21:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63782024-08-16T07:21:11.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63792024-08-16T07:21:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63802024-08-16T07:21:11.287ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
63812024-08-16T07:21:11.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.592323ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63822024-08-16T07:21:11.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63832024-08-16T07:21:11.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
63842024-08-16T07:21:11.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63852024-08-16T07:21:11.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63862024-08-16T07:21:11.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
63872024-08-16T07:21:11.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.664209ms iteration = 27 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
63882024-08-16T07:21:13.018ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1444 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 0a487089-010d-49c0-b3a7-e128e931244b response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
63892024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
63902024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
63912024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63922024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63932024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
63942024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
63952024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
63962024-08-16T07:21:21.281ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
63972024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
63982024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
63992024-08-16T07:21:21.281ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
64002024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
64012024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64022024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64032024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64042024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
64052024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64062024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
64072024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64082024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64092024-08-16T07:21:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64102024-08-16T07:21:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64112024-08-16T07:21:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
64122024-08-16T07:21:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64132024-08-16T07:21:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64142024-08-16T07:21:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64152024-08-16T07:21:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64162024-08-16T07:21:21.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64172024-08-16T07:21:21.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64182024-08-16T07:21:21.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
64192024-08-16T07:21:21.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
64202024-08-16T07:21:21.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64212024-08-16T07:21:21.283ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
64222024-08-16T07:21:21.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64232024-08-16T07:21:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64242024-08-16T07:21:21.284ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64252024-08-16T07:21:21.284ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
64262024-08-16T07:21:21.284ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.745053ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64272024-08-16T07:21:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64282024-08-16T07:21:21.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64292024-08-16T07:21:21.285ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1344, tv_nsec: 661926071 } })
64302024-08-16T07:21:21.285ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1344, tv_nsec: 662087325 } })
64312024-08-16T07:21:21.285ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64322024-08-16T07:21:21.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64332024-08-16T07:21:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64342024-08-16T07:21:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64352024-08-16T07:21:21.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64362024-08-16T07:21:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64372024-08-16T07:21:21.286ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
64382024-08-16T07:21:21.286ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
64392024-08-16T07:21:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64402024-08-16T07:21:21.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64412024-08-16T07:21:21.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
64422024-08-16T07:21:21.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.03238ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64432024-08-16T07:21:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64442024-08-16T07:21:21.287ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64452024-08-16T07:21:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64462024-08-16T07:21:21.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64472024-08-16T07:21:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64482024-08-16T07:21:21.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64492024-08-16T07:21:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64502024-08-16T07:21:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64512024-08-16T07:21:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64522024-08-16T07:21:21.288ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1344, tv_nsec: 665210547 } })
64532024-08-16T07:21:21.288ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64542024-08-16T07:21:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64552024-08-16T07:21:21.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
64562024-08-16T07:21:21.289ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
64572024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 7.392961ms iteration = 10 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
64582024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64592024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
64602024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64612024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64622024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
64632024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64642024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64652024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64662024-08-16T07:21:21.289ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
64672024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64682024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
64692024-08-16T07:21:21.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64702024-08-16T07:21:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64712024-08-16T07:21:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64722024-08-16T07:21:21.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64732024-08-16T07:21:21.290ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
64742024-08-16T07:21:21.291ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
64752024-08-16T07:21:21.291ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
64762024-08-16T07:21:21.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64772024-08-16T07:21:21.291ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
64782024-08-16T07:21:21.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
64792024-08-16T07:21:21.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64802024-08-16T07:21:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64812024-08-16T07:21:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64822024-08-16T07:21:21.291ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64832024-08-16T07:21:21.291ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
64842024-08-16T07:21:21.291ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
64852024-08-16T07:21:21.291ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64862024-08-16T07:21:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64872024-08-16T07:21:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64882024-08-16T07:21:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
64892024-08-16T07:21:21.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64902024-08-16T07:21:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64912024-08-16T07:21:21.292ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
64922024-08-16T07:21:21.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.678429ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
64932024-08-16T07:21:21.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64942024-08-16T07:21:21.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64952024-08-16T07:21:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64962024-08-16T07:21:21.293ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
64972024-08-16T07:21:21.293ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64982024-08-16T07:21:21.293ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 4.394411ms iteration = 10 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
64992024-08-16T07:21:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65002024-08-16T07:21:21.293ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65012024-08-16T07:21:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65022024-08-16T07:21:21.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65032024-08-16T07:21:21.294ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65042024-08-16T07:21:21.294ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 10.601755ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65052024-08-16T07:21:21.294ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65062024-08-16T07:21:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65072024-08-16T07:21:21.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65082024-08-16T07:21:21.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65092024-08-16T07:21:21.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65102024-08-16T07:21:21.296ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65112024-08-16T07:21:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65122024-08-16T07:21:21.298ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
65132024-08-16T07:21:21.298ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.982562ms iteration = 28 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
65142024-08-16T07:21:21.301ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
65152024-08-16T07:21:21.301ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 19.614504ms iteration = 12 status = {"physical_disks_added":0}
65162024-08-16T07:21:21.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65172024-08-16T07:21:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65182024-08-16T07:21:21.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65192024-08-16T07:21:21.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65202024-08-16T07:21:21.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65212024-08-16T07:21:21.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65222024-08-16T07:21:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65232024-08-16T07:21:21.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65242024-08-16T07:21:21.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65252024-08-16T07:21:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65262024-08-16T07:21:21.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65272024-08-16T07:21:21.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65282024-08-16T07:21:21.309ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65292024-08-16T07:21:21.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65302024-08-16T07:21:21.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65312024-08-16T07:21:21.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
65322024-08-16T07:21:21.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65332024-08-16T07:21:21.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65342024-08-16T07:21:21.310ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 29.40992ms iteration = 10 status = 0
65352024-08-16T07:21:21.321ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
65362024-08-16T07:21:21.321ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 30.269449ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
65372024-08-16T07:21:21.400ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
65382024-08-16T07:21:21.400ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65392024-08-16T07:21:21.400ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "53d6a069-1755-4c48-a6f9-f490a736d9c2", "content-length": "26", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
65402024-08-16T07:21:21.400ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65412024-08-16T07:21:21.402ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65422024-08-16T07:21:21.409ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
65432024-08-16T07:21:21.409ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65442024-08-16T07:21:21.410ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f25e54be-60ae-4958-b29d-a82e335a202f", "content-length": "26", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
65452024-08-16T07:21:21.410ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65462024-08-16T07:21:21.412ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
65472024-08-16T07:21:21.426ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
65482024-08-16T07:21:21.426ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65492024-08-16T07:21:21.426ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aebddbe1-23ec-4b31-b5c3-715bef74b725", "content-length": "26", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
65502024-08-16T07:21:21.426ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65512024-08-16T07:21:21.428ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65522024-08-16T07:21:21.431ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65532024-08-16T07:21:21.432ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a1dc8b28-a707-4d69-8b16-3cec5111c534", "content-length": "372", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
65542024-08-16T07:21:21.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65552024-08-16T07:21:21.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65562024-08-16T07:21:21.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65572024-08-16T07:21:21.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65582024-08-16T07:21:21.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65592024-08-16T07:21:21.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65602024-08-16T07:21:21.437ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65612024-08-16T07:21:21.438ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ec6f46dc-4e35-479d-883d-f733aa3126e5", "content-length": "691", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
65622024-08-16T07:21:21.438ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
65632024-08-16T07:21:21.438ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
65642024-08-16T07:21:21.438ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
65652024-08-16T07:21:21.439ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 157.956298ms iteration = 10 status = {}
65662024-08-16T07:21:21.439ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65672024-08-16T07:21:21.440ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ce3d54f1-64e0-4f5c-94d0-1266ff6fb49b", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
65682024-08-16T07:21:21.441ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 152.161304ms iteration = 11 status = {}
65692024-08-16T07:21:21.513ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 231.591599ms iteration = 10 status = {}
65702024-08-16T07:21:21.520ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65712024-08-16T07:21:21.521ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7cebe167-83cc-4fa6-82bc-122dfa217d98", "content-length": "1", "date": "Fri, 16 Aug 2024 07:21:20 GMT"} })
65722024-08-16T07:21:21.522ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65732024-08-16T07:21:21.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65742024-08-16T07:21:21.523ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 241.735563ms iteration = 10 status = null
65752024-08-16T07:21:21.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65762024-08-16T07:21:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65772024-08-16T07:21:21.576ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
65782024-08-16T07:21:21.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65792024-08-16T07:21:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65802024-08-16T07:21:21.585ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
65812024-08-16T07:21:21.585ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f61e59f3-aa1c-4421-8e5d-b958c6671213", "content-length": "121", "date": "Fri, 16 Aug 2024 07:21:20 GMT"} })
65822024-08-16T07:21:21.585ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
65832024-08-16T07:21:21.585ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
65842024-08-16T07:21:21.585ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
65852024-08-16T07:21:21.585ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
65862024-08-16T07:21:21.585ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
65872024-08-16T07:21:21.585ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
65882024-08-16T07:21:21.585ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
65892024-08-16T07:21:21.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65902024-08-16T07:21:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65912024-08-16T07:21:21.587ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65922024-08-16T07:21:21.587ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cc4b3377-d69a-451d-b14c-0d645999e353", "content-length": "2", "date": "Fri, 16 Aug 2024 07:21:20 GMT"} })
65932024-08-16T07:21:21.587ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65942024-08-16T07:21:21.588ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ee1cac7e-26e8-4657-b3ee-620fee288989", "content-length": "52", "date": "Fri, 16 Aug 2024 07:21:20 GMT"} })
65952024-08-16T07:21:21.588ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
65962024-08-16T07:21:21.588ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65972024-08-16T07:21:21.638ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "08ebbee1-541a-478a-962a-67fe2c4ead0c", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
65982024-08-16T07:21:21.638ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
65992024-08-16T07:21:21.638ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
66002024-08-16T07:21:21.639ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8b2ee5ce-9e8d-471b-9c1b-974e43ab2d6c", "content-length": "494", "date": "Fri, 16 Aug 2024 07:21:21 GMT"} })
66012024-08-16T07:21:21.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66022024-08-16T07:21:21.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66032024-08-16T07:21:21.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66042024-08-16T07:21:21.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66052024-08-16T07:21:21.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66062024-08-16T07:21:21.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66072024-08-16T07:21:21.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66082024-08-16T07:21:21.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66092024-08-16T07:21:21.653ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 372.045162ms iteration = 10 status = {}
66102024-08-16T07:21:23.018ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 628dc8f6-18c6-46ff-9617-7809b34bca17 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
66112024-08-16T07:21:31.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
66122024-08-16T07:21:31.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66132024-08-16T07:21:31.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66142024-08-16T07:21:31.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
66152024-08-16T07:21:31.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
66162024-08-16T07:21:31.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66172024-08-16T07:21:31.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66182024-08-16T07:21:31.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66192024-08-16T07:21:31.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66202024-08-16T07:21:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66212024-08-16T07:21:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66222024-08-16T07:21:31.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66232024-08-16T07:21:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66242024-08-16T07:21:31.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
66252024-08-16T07:21:31.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.100092ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66262024-08-16T07:21:31.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66272024-08-16T07:21:31.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66282024-08-16T07:21:31.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66292024-08-16T07:21:31.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
66302024-08-16T07:21:31.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66312024-08-16T07:21:31.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66322024-08-16T07:21:31.297ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
66332024-08-16T07:21:31.297ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.838786ms iteration = 29 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
66342024-08-16T07:21:33.017ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1302 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 078a9b0f-96af-4604-9546-281593f12063 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
66352024-08-16T07:21:41.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
66362024-08-16T07:21:41.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66372024-08-16T07:21:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66382024-08-16T07:21:41.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
66392024-08-16T07:21:41.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
66402024-08-16T07:21:41.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66412024-08-16T07:21:41.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66422024-08-16T07:21:41.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66432024-08-16T07:21:41.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66442024-08-16T07:21:41.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66452024-08-16T07:21:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66462024-08-16T07:21:41.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66472024-08-16T07:21:41.285ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
66482024-08-16T07:21:41.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.694032ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66492024-08-16T07:21:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66502024-08-16T07:21:41.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66512024-08-16T07:21:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66522024-08-16T07:21:41.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66532024-08-16T07:21:41.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
66542024-08-16T07:21:41.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66552024-08-16T07:21:41.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66562024-08-16T07:21:41.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
66572024-08-16T07:21:41.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 13.943732ms iteration = 30 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
66582024-08-16T07:21:43.017ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1475 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 79263d4b-c794-4f39-b6db-47f8cb663152 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
66592024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
66602024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
66612024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66622024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66632024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
66642024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
66652024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66662024-08-16T07:21:51.281ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
66672024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66682024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
66692024-08-16T07:21:51.281ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
66702024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
66712024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
66722024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66732024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
66742024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66752024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
66762024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66772024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
66782024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
66792024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
66802024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66812024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
66822024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66832024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
66842024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66852024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
66862024-08-16T07:21:51.281ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
66872024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66882024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
66892024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
66902024-08-16T07:21:51.281ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:11:51.281419579 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
66912024-08-16T07:21:51.281ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
66922024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
66932024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
66942024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.271\u{b5}s iteration = 7 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
66952024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
66962024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
66972024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
66982024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66992024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67002024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67012024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67022024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67032024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67042024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67052024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67062024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67072024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67082024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67092024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67102024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
67112024-08-16T07:21:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67122024-08-16T07:21:51.282ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 658785242 } })
67132024-08-16T07:21:51.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67142024-08-16T07:21:51.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
67152024-08-16T07:21:51.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
67162024-08-16T07:21:51.283ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
67172024-08-16T07:21:51.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67182024-08-16T07:21:51.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67192024-08-16T07:21:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67202024-08-16T07:21:51.283ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 659964199 } })
67212024-08-16T07:21:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67222024-08-16T07:21:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67232024-08-16T07:21:51.283ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67242024-08-16T07:21:51.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67252024-08-16T07:21:51.284ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
67262024-08-16T07:21:51.284ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.48885ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67272024-08-16T07:21:51.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67282024-08-16T07:21:51.285ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
67292024-08-16T07:21:51.285ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.991003ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
67302024-08-16T07:21:51.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67312024-08-16T07:21:51.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67322024-08-16T07:21:51.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
67332024-08-16T07:21:51.286ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67342024-08-16T07:21:51.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67352024-08-16T07:21:51.286ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:11:51.281419579 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
67362024-08-16T07:21:51.286ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.231381ms iteration = 6 status = {"expiration":"2024-08-16T07:11:51.281419579Z","pruned":[]}
67372024-08-16T07:21:51.286ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
67382024-08-16T07:21:51.286ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.320963ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
67392024-08-16T07:21:51.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 663642934 } })
67402024-08-16T07:21:51.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 663653234 } })
67412024-08-16T07:21:51.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67422024-08-16T07:21:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67432024-08-16T07:21:51.287ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67442024-08-16T07:21:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67452024-08-16T07:21:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67462024-08-16T07:21:51.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67472024-08-16T07:21:51.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
67482024-08-16T07:21:51.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
67492024-08-16T07:21:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67502024-08-16T07:21:51.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67512024-08-16T07:21:51.288ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67522024-08-16T07:21:51.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67532024-08-16T07:21:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67542024-08-16T07:21:51.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67552024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
67562024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
67572024-08-16T07:21:51.289ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
67582024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
67592024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67602024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
67612024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67622024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67632024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
67642024-08-16T07:21:51.289ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
67652024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67662024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67672024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67682024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
67692024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67702024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67712024-08-16T07:21:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67722024-08-16T07:21:51.290ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
67732024-08-16T07:21:51.290ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
67742024-08-16T07:21:51.290ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67752024-08-16T07:21:51.290ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
67762024-08-16T07:21:51.290ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
67772024-08-16T07:21:51.290ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
67782024-08-16T07:21:51.290ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
67792024-08-16T07:21:51.290ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
67802024-08-16T07:21:51.290ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67812024-08-16T07:21:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
67822024-08-16T07:21:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67832024-08-16T07:21:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67842024-08-16T07:21:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67852024-08-16T07:21:51.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67862024-08-16T07:21:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67872024-08-16T07:21:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67882024-08-16T07:21:51.292ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67892024-08-16T07:21:51.292ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
67902024-08-16T07:21:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 11.508326ms iteration = 11 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
67912024-08-16T07:21:51.293ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67922024-08-16T07:21:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67932024-08-16T07:21:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67942024-08-16T07:21:51.295ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67952024-08-16T07:21:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67962024-08-16T07:21:51.296ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67972024-08-16T07:21:51.297ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67982024-08-16T07:21:51.297ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
67992024-08-16T07:21:51.297ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
68002024-08-16T07:21:51.297ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
68012024-08-16T07:21:51.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68022024-08-16T07:21:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68032024-08-16T07:21:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68042024-08-16T07:21:51.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68052024-08-16T07:21:51.297ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 674325001 } })
68062024-08-16T07:21:51.298ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
68072024-08-16T07:21:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
68082024-08-16T07:21:51.299ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68092024-08-16T07:21:51.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68102024-08-16T07:21:51.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68112024-08-16T07:21:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68122024-08-16T07:21:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68132024-08-16T07:21:51.299ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
68142024-08-16T07:21:51.299ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
68152024-08-16T07:21:51.299ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.880032ms iteration = 6 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
68162024-08-16T07:21:51.300ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68172024-08-16T07:21:51.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68182024-08-16T07:21:51.301ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68192024-08-16T07:21:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68202024-08-16T07:21:51.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68212024-08-16T07:21:51.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68222024-08-16T07:21:51.303ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
68232024-08-16T07:21:51.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68242024-08-16T07:21:51.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68252024-08-16T07:21:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68262024-08-16T07:21:51.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68272024-08-16T07:21:51.304ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68282024-08-16T07:21:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68292024-08-16T07:21:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68302024-08-16T07:21:51.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68312024-08-16T07:21:51.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68322024-08-16T07:21:51.304ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68332024-08-16T07:21:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68342024-08-16T07:21:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
68352024-08-16T07:21:51.305ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68362024-08-16T07:21:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68372024-08-16T07:21:51.305ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
68382024-08-16T07:21:51.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.711433ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
68392024-08-16T07:21:51.306ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
68402024-08-16T07:21:51.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.990119ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
68412024-08-16T07:21:51.306ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68422024-08-16T07:21:51.306ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.195725ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68432024-08-16T07:21:51.306ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
68442024-08-16T07:21:51.306ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
68452024-08-16T07:21:51.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68462024-08-16T07:21:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68472024-08-16T07:21:51.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68482024-08-16T07:21:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68492024-08-16T07:21:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68502024-08-16T07:21:51.307ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68512024-08-16T07:21:51.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68522024-08-16T07:21:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68532024-08-16T07:21:51.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68542024-08-16T07:21:51.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68552024-08-16T07:21:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68562024-08-16T07:21:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68572024-08-16T07:21:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68582024-08-16T07:21:51.308ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
68592024-08-16T07:21:51.308ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68602024-08-16T07:21:51.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68612024-08-16T07:21:51.308ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
68622024-08-16T07:21:51.308ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
68632024-08-16T07:21:51.308ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
68642024-08-16T07:21:51.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68652024-08-16T07:21:51.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68662024-08-16T07:21:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68672024-08-16T07:21:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68682024-08-16T07:21:51.309ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
68692024-08-16T07:21:51.309ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.219413ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
68702024-08-16T07:21:51.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68712024-08-16T07:21:51.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68722024-08-16T07:21:51.310ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
68732024-08-16T07:21:51.310ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68742024-08-16T07:21:51.310ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 21.432845ms iteration = 11 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
68752024-08-16T07:21:51.310ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68762024-08-16T07:21:51.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68772024-08-16T07:21:51.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68782024-08-16T07:21:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68792024-08-16T07:21:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68802024-08-16T07:21:51.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68812024-08-16T07:21:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68822024-08-16T07:21:51.313ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68832024-08-16T07:21:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68842024-08-16T07:21:51.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68852024-08-16T07:21:51.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68862024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68872024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68882024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68892024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
68902024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68912024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68922024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68932024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68942024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
68952024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
68962024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
68972024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 33.070934ms iteration = 7 status = {"generation":2}
68982024-08-16T07:21:51.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68992024-08-16T07:21:51.314ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
69002024-08-16T07:21:51.315ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 33.602096ms iteration = 13 status = {"physical_disks_added":0}
69012024-08-16T07:21:51.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69022024-08-16T07:21:51.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69032024-08-16T07:21:51.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69042024-08-16T07:21:51.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69052024-08-16T07:21:51.315ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
69062024-08-16T07:21:51.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69072024-08-16T07:21:51.315ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.563122ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69082024-08-16T07:21:51.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69092024-08-16T07:21:51.316ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
69102024-08-16T07:21:51.316ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
69112024-08-16T07:21:51.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69122024-08-16T07:21:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69132024-08-16T07:21:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69142024-08-16T07:21:51.317ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69152024-08-16T07:21:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69162024-08-16T07:21:51.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69172024-08-16T07:21:51.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69182024-08-16T07:21:51.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69192024-08-16T07:21:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
69202024-08-16T07:21:51.319ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69212024-08-16T07:21:51.319ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69222024-08-16T07:21:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69232024-08-16T07:21:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69242024-08-16T07:21:51.320ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
69252024-08-16T07:21:51.320ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.855627ms iteration = 31 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
69262024-08-16T07:21:51.320ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69272024-08-16T07:21:51.320ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 39.40253ms iteration = 11 status = 0
69282024-08-16T07:21:51.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69292024-08-16T07:21:51.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69302024-08-16T07:21:51.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69312024-08-16T07:21:51.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69322024-08-16T07:21:51.323ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69332024-08-16T07:21:51.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69342024-08-16T07:21:51.323ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
69352024-08-16T07:21:51.323ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
69362024-08-16T07:21:51.323ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
69372024-08-16T07:21:51.323ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 42.597683ms iteration = 7 status = {"generation":1}
69382024-08-16T07:21:51.325ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69392024-08-16T07:21:51.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69402024-08-16T07:21:51.327ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69412024-08-16T07:21:51.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69422024-08-16T07:21:51.328ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69432024-08-16T07:21:51.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69442024-08-16T07:21:51.329ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69452024-08-16T07:21:51.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69462024-08-16T07:21:51.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69472024-08-16T07:21:51.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69482024-08-16T07:21:51.331ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69492024-08-16T07:21:51.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69502024-08-16T07:21:51.331ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
69512024-08-16T07:21:51.331ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
69522024-08-16T07:21:51.331ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 50.566177ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
69532024-08-16T07:21:51.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69542024-08-16T07:21:51.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
69552024-08-16T07:21:51.335ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69562024-08-16T07:21:51.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69572024-08-16T07:21:51.336ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69582024-08-16T07:21:51.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69592024-08-16T07:21:51.337ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69602024-08-16T07:21:51.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69612024-08-16T07:21:51.339ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69622024-08-16T07:21:51.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69632024-08-16T07:21:51.341ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69642024-08-16T07:21:51.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69652024-08-16T07:21:51.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69662024-08-16T07:21:51.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69672024-08-16T07:21:51.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69682024-08-16T07:21:51.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69692024-08-16T07:21:51.343ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69702024-08-16T07:21:51.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69712024-08-16T07:21:51.344ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69722024-08-16T07:21:51.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
69732024-08-16T07:21:51.347ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69742024-08-16T07:21:51.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69752024-08-16T07:21:51.348ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69762024-08-16T07:21:51.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69772024-08-16T07:21:51.348ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) }
69782024-08-16T07:21:51.348ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 67.690133ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
69792024-08-16T07:21:51.349ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69802024-08-16T07:21:51.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69812024-08-16T07:21:51.350ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69822024-08-16T07:21:51.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69832024-08-16T07:21:51.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69842024-08-16T07:21:51.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69852024-08-16T07:21:51.353ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69862024-08-16T07:21:51.353ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69872024-08-16T07:21:51.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69882024-08-16T07:21:51.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
69892024-08-16T07:21:51.354ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69902024-08-16T07:21:51.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69912024-08-16T07:21:51.354ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69922024-08-16T07:21:51.356ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69932024-08-16T07:21:51.356ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69942024-08-16T07:21:51.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69952024-08-16T07:21:51.358ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69962024-08-16T07:21:51.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69972024-08-16T07:21:51.359ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69982024-08-16T07:21:51.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69992024-08-16T07:21:51.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70002024-08-16T07:21:51.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70012024-08-16T07:21:51.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70022024-08-16T07:21:51.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70032024-08-16T07:21:51.365ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70042024-08-16T07:21:51.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70052024-08-16T07:21:51.366ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70062024-08-16T07:21:51.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70072024-08-16T07:21:51.367ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70082024-08-16T07:21:51.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70092024-08-16T07:21:51.369ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70102024-08-16T07:21:51.375ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
70112024-08-16T07:21:51.375ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70122024-08-16T07:21:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70132024-08-16T07:21:51.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70142024-08-16T07:21:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70152024-08-16T07:21:51.377ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70162024-08-16T07:21:51.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70172024-08-16T07:21:51.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70182024-08-16T07:21:51.381ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
70192024-08-16T07:21:51.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70202024-08-16T07:21:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70212024-08-16T07:21:51.391ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 0394c19d-c776-4986-aadf-3eb1689e7bef, kind: Service { id: dec19c15-1a2d-47ac-9b9e-9f424d3a3464 }, name: Name("external-dns-dec19c15-1a2d-47ac-9b9e-9f424d3a3464"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e9bad3ae-7417-4456-8d3e-34e4cbaa5de1, kind: Service { id: f9649eef-936b-4765-9810-da8662275db5 }, name: Name("external-dns-f9649eef-936b-4765-9810-da8662275db5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 132])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 036a4ce6-ea03-4027-b4fc-46b08e5aab80, kind: Service { id: 0d900881-9285-4dbf-910f-5e4676c8f133 }, name: Name("nexus-0d900881-9285-4dbf-910f-5e4676c8f133"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d720059-2cc6-4a99-8f2a-da62f41fe70c, kind: Service { id: 09eed6fc-f2ea-4ebd-a66c-d8895818c00c }, name: Name("nexus-09eed6fc-f2ea-4ebd-a66c-d8895818c00c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: addeeb4f-a7d0-4d63-8259-b305b18b5ab1, kind: Service { id: 30e79e9e-c63b-4bdf-99e7-c71a02ecefc5 }, name: Name("nexus-30e79e9e-c63b-4bdf-99e7-c71a02ecefc5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
70222024-08-16T07:21:51.391ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70232024-08-16T07:21:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70242024-08-16T07:21:51.398ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70252024-08-16T07:21:51.400ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
70262024-08-16T07:21:51.400ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70272024-08-16T07:21:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70282024-08-16T07:21:51.401ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
70292024-08-16T07:21:51.401ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0394c19d-c776-4986-aadf-3eb1689e7bef, kind: Service { id: dec19c15-1a2d-47ac-9b9e-9f424d3a3464 }, name: Name("external-dns-dec19c15-1a2d-47ac-9b9e-9f424d3a3464"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 149])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e9bad3ae-7417-4456-8d3e-34e4cbaa5de1, kind: Service { id: f9649eef-936b-4765-9810-da8662275db5 }, name: Name("external-dns-f9649eef-936b-4765-9810-da8662275db5"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 132])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 036a4ce6-ea03-4027-b4fc-46b08e5aab80, kind: Service { id: 0d900881-9285-4dbf-910f-5e4676c8f133 }, name: Name("nexus-0d900881-9285-4dbf-910f-5e4676c8f133"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 237])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d720059-2cc6-4a99-8f2a-da62f41fe70c, kind: Service { id: 09eed6fc-f2ea-4ebd-a66c-d8895818c00c }, name: Name("nexus-09eed6fc-f2ea-4ebd-a66c-d8895818c00c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: addeeb4f-a7d0-4d63-8259-b305b18b5ab1, kind: Service { id: 30e79e9e-c63b-4bdf-99e7-c71a02ecefc5 }, name: Name("nexus-30e79e9e-c63b-4bdf-99e7-c71a02ecefc5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 154])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
70302024-08-16T07:21:51.402ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
70312024-08-16T07:21:51.456ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
70322024-08-16T07:21:51.456ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70332024-08-16T07:21:51.457ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "10ca76cc-e6b4-4f9e-9f9e-fd083ffbf507", "content-length": "26", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
70342024-08-16T07:21:51.457ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70352024-08-16T07:21:51.459ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70362024-08-16T07:21:51.463ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, time_created: 2024-08-16T07:16:52.894284Z, time_modified: 2024-08-16T07:16:52.894284Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
70372024-08-16T07:21:51.463ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
70382024-08-16T07:21:51.463ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70392024-08-16T07:21:51.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70402024-08-16T07:21:51.465ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
70412024-08-16T07:21:51.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
70422024-08-16T07:21:51.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70432024-08-16T07:21:51.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
70442024-08-16T07:21:51.555ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
70452024-08-16T07:21:51.555ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70462024-08-16T07:21:51.555ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3266b687-2252-4849-8bab-5bf9508761b9", "content-length": "26", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
70472024-08-16T07:21:51.555ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70482024-08-16T07:21:51.557ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
70492024-08-16T07:21:51.583ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
70502024-08-16T07:21:51.608ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
70512024-08-16T07:21:51.632ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70522024-08-16T07:21:51.633ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9c426984-80be-4e5b-8112-ccfcf2a5c4c0", "content-length": "691", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
70532024-08-16T07:21:51.633ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
70542024-08-16T07:21:51.633ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
70552024-08-16T07:21:51.633ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
70562024-08-16T07:21:51.634ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 353.278439ms iteration = 11 status = {}
70572024-08-16T07:21:51.675ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
70582024-08-16T07:21:51.675ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c88a2b28-f941-4857-a17f-46ef47c36b63", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
70592024-08-16T07:21:51.677ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
70602024-08-16T07:21:51.677ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 387.94867ms
70612024-08-16T07:21:51.677ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 387.95616ms iteration = 2 status = {}
70622024-08-16T07:21:51.684ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
70632024-08-16T07:21:51.685ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "71b91651-b248-4bba-b3cf-362296d92b70", "content-length": "1", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
70642024-08-16T07:21:51.686ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70652024-08-16T07:21:51.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70662024-08-16T07:21:51.688ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 406.868326ms iteration = 11 status = null
70672024-08-16T07:21:51.703ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
70682024-08-16T07:21:51.703ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70692024-08-16T07:21:51.703ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c6c1b7b4-d936-4e97-bda4-7afcb98f7b94", "content-length": "26", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
70702024-08-16T07:21:51.703ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70712024-08-16T07:21:51.705ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70722024-08-16T07:21:51.779ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70732024-08-16T07:21:51.780ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4581c268-aebc-4483-b6bf-530064d90b85", "content-length": "372", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
70742024-08-16T07:21:51.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70752024-08-16T07:21:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70762024-08-16T07:21:51.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70772024-08-16T07:21:51.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70782024-08-16T07:21:51.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70792024-08-16T07:21:51.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70802024-08-16T07:21:51.788ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70812024-08-16T07:21:51.789ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1b49bc11-b376-4720-b9af-c92b74b82a92", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
70822024-08-16T07:21:51.790ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 501.85943ms iteration = 12 status = {}
70832024-08-16T07:21:51.804ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
70842024-08-16T07:21:51.847ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 566.303688ms iteration = 11 status = {}
70852024-08-16T07:21:51.906ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
70862024-08-16T07:21:51.907ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f215c712-c06b-403f-b3fb-a44a1d8938ee", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70872024-08-16T07:21:51.907ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70882024-08-16T07:21:51.909ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2da62c41-bfa9-4235-b72e-82db81d2a77c", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70892024-08-16T07:21:51.909ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70902024-08-16T07:21:51.910ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
70912024-08-16T07:21:51.911ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70922024-08-16T07:21:51.911ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 629.716673ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
70932024-08-16T07:21:51.911ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c9a8654d-66d3-4c71-9d23-3ab0dd700165", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
70942024-08-16T07:21:51.911ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
70952024-08-16T07:21:51.913ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b42382d5-51da-41a5-9caf-f3b377f9149e", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
70962024-08-16T07:21:51.913ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
70972024-08-16T07:21:51.915ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e1419632-3057-45aa-b6f7-56e4cd32a090", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
70982024-08-16T07:21:51.915ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
70992024-08-16T07:21:51.917ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
71002024-08-16T07:21:51.917ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 636.09266ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
71012024-08-16T07:21:51.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71022024-08-16T07:21:51.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71032024-08-16T07:21:51.971ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
71042024-08-16T07:21:51.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71052024-08-16T07:21:51.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71062024-08-16T07:21:51.977ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71072024-08-16T07:21:51.978ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "40add127-3823-4c19-9b12-55d3d52dd497", "content-length": "121", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
71082024-08-16T07:21:51.978ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
71092024-08-16T07:21:51.978ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
71102024-08-16T07:21:51.978ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
71112024-08-16T07:21:51.978ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
71122024-08-16T07:21:51.978ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
71132024-08-16T07:21:51.978ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
71142024-08-16T07:21:51.978ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
71152024-08-16T07:21:51.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71162024-08-16T07:21:51.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71172024-08-16T07:21:51.980ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71182024-08-16T07:21:51.981ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "516be735-3291-44b4-a280-e6b1d533282e", "content-length": "2", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
71192024-08-16T07:21:51.981ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71202024-08-16T07:21:51.981ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "37284d53-19ee-4af9-a6bc-c8057536ccf3", "content-length": "52", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
71212024-08-16T07:21:51.981ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
71222024-08-16T07:21:51.981ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71232024-08-16T07:21:52.032ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c97a9e98-5273-4ad3-b2a6-910390682a34", "date": "Fri, 16 Aug 2024 07:21:51 GMT"} })
71242024-08-16T07:21:52.032ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
71252024-08-16T07:21:52.032ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
71262024-08-16T07:21:52.033ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4118fdc2-a069-47fb-a616-e3d8192ecd33", "content-length": "494", "date": "Fri, 16 Aug 2024 07:21:52 GMT"} })
71272024-08-16T07:21:52.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71282024-08-16T07:21:52.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71292024-08-16T07:21:52.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71302024-08-16T07:21:52.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71312024-08-16T07:21:52.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71322024-08-16T07:21:52.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71332024-08-16T07:21:52.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71342024-08-16T07:21:52.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71352024-08-16T07:21:52.047ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 766.401349ms iteration = 11 status = {}
71362024-08-16T07:21:53.017ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1419 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 687920ca-523d-471c-a30a-ad4e8401717d response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
71372024-08-16T07:22:01.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
71382024-08-16T07:22:01.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71392024-08-16T07:22:01.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71402024-08-16T07:22:01.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
71412024-08-16T07:22:01.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
71422024-08-16T07:22:01.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71432024-08-16T07:22:01.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71442024-08-16T07:22:01.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71452024-08-16T07:22:01.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71462024-08-16T07:22:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71472024-08-16T07:22:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71482024-08-16T07:22:01.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71492024-08-16T07:22:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71502024-08-16T07:22:01.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
71512024-08-16T07:22:01.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.087741ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71522024-08-16T07:22:01.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71532024-08-16T07:22:01.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71542024-08-16T07:22:01.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71552024-08-16T07:22:01.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
71562024-08-16T07:22:01.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71572024-08-16T07:22:01.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71582024-08-16T07:22:01.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
71592024-08-16T07:22:01.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.628378ms iteration = 32 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
71602024-08-16T07:22:03.017ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1291 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 146b1ee0-eae3-4c94-933a-5350be5d98b7 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
71612024-08-16T07:22:03.018ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
71622024-08-16T07:22:03.018ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
71632024-08-16T07:22:03.049ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
71642024-08-16T07:22:03.049ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:36498
71652024-08-16T07:22:03.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36498 req_id = fbc985f1-6d3f-48b0-b227-50622b152537 roles = RoleSet { roles: {} } uri = /metrics/producers
71662024-08-16T07:22:03.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36498 req_id = fbc985f1-6d3f-48b0-b227-50622b152537 resource = Database result = Ok(()) uri = /metrics/producers
71672024-08-16T07:22:03.084ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
71682024-08-16T07:22:03.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36498 req_id = fbc985f1-6d3f-48b0-b227-50622b152537 roles = RoleSet { roles: {} } uri = /metrics/producers
71692024-08-16T07:22:03.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36498 req_id = fbc985f1-6d3f-48b0-b227-50622b152537 resource = Database result = Ok(()) uri = /metrics/producers
71702024-08-16T07:22:03.117ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
71712024-08-16T07:22:03.117ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e28ff2e2-416b-4900-b9cf-a1bdab152d3b", "date": "Fri, 16 Aug 2024 07:22:03 GMT"} })
71722024-08-16T07:22:03.117ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
71732024-08-16T07:22:03.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 70248 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:36498 req_id = fbc985f1-6d3f-48b0-b227-50622b152537 response_code = 201 uri = /metrics/producers
71742024-08-16T07:22:03.119ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "fbc985f1-6d3f-48b0-b227-50622b152537", "content-length": "41", "date": "Fri, 16 Aug 2024 07:22:03 GMT"} })
71752024-08-16T07:22:03.120ZDEBGnexus (producer-registration-task): registered with nexus successfully
71762024-08-16T07:22:03.120ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
71772024-08-16T07:22:11.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
71782024-08-16T07:22:11.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71792024-08-16T07:22:11.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71802024-08-16T07:22:11.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71812024-08-16T07:22:11.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
71822024-08-16T07:22:11.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
71832024-08-16T07:22:11.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71842024-08-16T07:22:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71852024-08-16T07:22:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71862024-08-16T07:22:11.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71872024-08-16T07:22:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71882024-08-16T07:22:11.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71892024-08-16T07:22:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71902024-08-16T07:22:11.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71912024-08-16T07:22:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71922024-08-16T07:22:11.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
71932024-08-16T07:22:11.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.108261ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71942024-08-16T07:22:11.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71952024-08-16T07:22:11.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
71962024-08-16T07:22:11.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71972024-08-16T07:22:11.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71982024-08-16T07:22:11.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
71992024-08-16T07:22:11.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.362495ms iteration = 33 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
72002024-08-16T07:22:13.120ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1415 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = bb226ed7-ebb7-4891-b62c-6c9ed1a0a4d5 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
72012024-08-16T07:22:14.646ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:53702
72022024-08-16T07:22:14.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53702 req_id = 4aea03a8-effa-4f00-96f3-0fb1a34cb480 roles = RoleSet { roles: {} } uri = /metrics/producers
72032024-08-16T07:22:14.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53702 req_id = 4aea03a8-effa-4f00-96f3-0fb1a34cb480 resource = Database result = Ok(()) uri = /metrics/producers
72042024-08-16T07:22:14.678ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
72052024-08-16T07:22:14.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53702 req_id = 4aea03a8-effa-4f00-96f3-0fb1a34cb480 roles = RoleSet { roles: {} } uri = /metrics/producers
72062024-08-16T07:22:14.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53702 req_id = 4aea03a8-effa-4f00-96f3-0fb1a34cb480 resource = Database result = Ok(()) uri = /metrics/producers
72072024-08-16T07:22:14.717ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
72082024-08-16T07:22:14.718ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d8658a63-9b99-4734-a529-0fd790b7f287", "date": "Fri, 16 Aug 2024 07:22:14 GMT"} })
72092024-08-16T07:22:14.718ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
72102024-08-16T07:22:14.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 74447 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53702 req_id = 4aea03a8-effa-4f00-96f3-0fb1a34cb480 response_code = 201 uri = /metrics/producers
72112024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
72122024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
72132024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72142024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72152024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
72162024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
72172024-08-16T07:22:21.281ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
72182024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72192024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72202024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
72212024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72222024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
72232024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
72242024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72252024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72262024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
72272024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72282024-08-16T07:22:21.281ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
72292024-08-16T07:22:21.281ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
72302024-08-16T07:22:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72312024-08-16T07:22:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72322024-08-16T07:22:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72332024-08-16T07:22:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72342024-08-16T07:22:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72352024-08-16T07:22:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72362024-08-16T07:22:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72372024-08-16T07:22:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
72382024-08-16T07:22:21.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
72392024-08-16T07:22:21.282ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
72402024-08-16T07:22:21.282ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
72412024-08-16T07:22:21.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72422024-08-16T07:22:21.282ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72432024-08-16T07:22:21.283ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72442024-08-16T07:22:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72452024-08-16T07:22:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72462024-08-16T07:22:21.283ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72472024-08-16T07:22:21.284ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72482024-08-16T07:22:21.284ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1404, tv_nsec: 661143180 } })
72492024-08-16T07:22:21.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72502024-08-16T07:22:21.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72512024-08-16T07:22:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72522024-08-16T07:22:21.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72532024-08-16T07:22:21.285ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
72542024-08-16T07:22:21.285ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.43464ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72552024-08-16T07:22:21.285ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1404, tv_nsec: 662154243 } })
72562024-08-16T07:22:21.285ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
72572024-08-16T07:22:21.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
72582024-08-16T07:22:21.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.335457ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72592024-08-16T07:22:21.286ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
72602024-08-16T07:22:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72612024-08-16T07:22:21.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72622024-08-16T07:22:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72632024-08-16T07:22:21.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72642024-08-16T07:22:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72652024-08-16T07:22:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72662024-08-16T07:22:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72672024-08-16T07:22:21.287ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72682024-08-16T07:22:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72692024-08-16T07:22:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72702024-08-16T07:22:21.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72712024-08-16T07:22:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72722024-08-16T07:22:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72732024-08-16T07:22:21.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72742024-08-16T07:22:21.288ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
72752024-08-16T07:22:21.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72762024-08-16T07:22:21.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72772024-08-16T07:22:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72782024-08-16T07:22:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72792024-08-16T07:22:21.288ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72802024-08-16T07:22:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72812024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72822024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72832024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
72842024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72852024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
72862024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
72872024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72882024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
72892024-08-16T07:22:21.289ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
72902024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
72912024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
72922024-08-16T07:22:21.289ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
72932024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72942024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72952024-08-16T07:22:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
72962024-08-16T07:22:21.290ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1404, tv_nsec: 666930644 } })
72972024-08-16T07:22:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72982024-08-16T07:22:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72992024-08-16T07:22:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73002024-08-16T07:22:21.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73012024-08-16T07:22:21.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73022024-08-16T07:22:21.290ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
73032024-08-16T07:22:21.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 9.202152ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
73042024-08-16T07:22:21.291ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
73052024-08-16T07:22:21.291ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
73062024-08-16T07:22:21.291ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.74669ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
73072024-08-16T07:22:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73082024-08-16T07:22:21.292ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73092024-08-16T07:22:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73102024-08-16T07:22:21.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73112024-08-16T07:22:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73122024-08-16T07:22:21.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73132024-08-16T07:22:21.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73142024-08-16T07:22:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73152024-08-16T07:22:21.294ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
73162024-08-16T07:22:21.294ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.956614ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
73172024-08-16T07:22:21.295ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73182024-08-16T07:22:21.295ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 12.674893ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73192024-08-16T07:22:21.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
73202024-08-16T07:22:21.295ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73212024-08-16T07:22:21.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73222024-08-16T07:22:21.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73232024-08-16T07:22:21.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73242024-08-16T07:22:21.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73252024-08-16T07:22:21.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73262024-08-16T07:22:21.298ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
73272024-08-16T07:22:21.298ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73282024-08-16T07:22:21.298ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73292024-08-16T07:22:21.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73302024-08-16T07:22:21.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73312024-08-16T07:22:21.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73322024-08-16T07:22:21.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73332024-08-16T07:22:21.299ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
73342024-08-16T07:22:21.299ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 17.572476ms iteration = 14 status = {"physical_disks_added":0}
73352024-08-16T07:22:21.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73362024-08-16T07:22:21.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73372024-08-16T07:22:21.301ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
73382024-08-16T07:22:21.301ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.192347ms iteration = 34 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
73392024-08-16T07:22:21.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73402024-08-16T07:22:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73412024-08-16T07:22:21.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73422024-08-16T07:22:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73432024-08-16T07:22:21.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73442024-08-16T07:22:21.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73452024-08-16T07:22:21.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73462024-08-16T07:22:21.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73472024-08-16T07:22:21.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73482024-08-16T07:22:21.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73492024-08-16T07:22:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
73502024-08-16T07:22:21.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73512024-08-16T07:22:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73522024-08-16T07:22:21.307ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 26.051841ms iteration = 12 status = 0
73532024-08-16T07:22:21.307ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73542024-08-16T07:22:21.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73552024-08-16T07:22:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73562024-08-16T07:22:21.325ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
73572024-08-16T07:22:21.325ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73582024-08-16T07:22:21.325ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 36.031782ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
73592024-08-16T07:22:21.422ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
73602024-08-16T07:22:21.422ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73612024-08-16T07:22:21.423ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd7083e1-8319-44e7-b497-879c9753b6f8", "content-length": "26", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
73622024-08-16T07:22:21.423ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73632024-08-16T07:22:21.425ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73642024-08-16T07:22:21.426ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
73652024-08-16T07:22:21.426ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73662024-08-16T07:22:21.426ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ec014b63-902d-447d-87d5-f429c3f45870", "content-length": "26", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
73672024-08-16T07:22:21.427ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73682024-08-16T07:22:21.428ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
73692024-08-16T07:22:21.448ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73702024-08-16T07:22:21.448ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e8033860-9358-4e5f-a14d-59d6d24359c7", "content-length": "372", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
73712024-08-16T07:22:21.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73722024-08-16T07:22:21.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73732024-08-16T07:22:21.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73742024-08-16T07:22:21.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73752024-08-16T07:22:21.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73762024-08-16T07:22:21.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73772024-08-16T07:22:21.456ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73782024-08-16T07:22:21.456ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9953f3b4-4133-401f-a7da-b8e5be31e5b4", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
73792024-08-16T07:22:21.458ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 168.637624ms iteration = 13 status = {}
73802024-08-16T07:22:21.502ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
73812024-08-16T07:22:21.502ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73822024-08-16T07:22:21.502ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "54256abd-1df8-4681-bee6-fef0da3a675e", "content-length": "26", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
73832024-08-16T07:22:21.502ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73842024-08-16T07:22:21.504ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73852024-08-16T07:22:21.523ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73862024-08-16T07:22:21.524ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a037ef58-b497-4dcf-babc-ab08b7016b68", "content-length": "691", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
73872024-08-16T07:22:21.524ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
73882024-08-16T07:22:21.524ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
73892024-08-16T07:22:21.524ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
73902024-08-16T07:22:21.526ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 244.524197ms iteration = 12 status = {}
73912024-08-16T07:22:21.534ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73922024-08-16T07:22:21.535ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6dcf615a-3cc5-41a2-b7e7-f40c59e43068", "content-length": "1", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
73932024-08-16T07:22:21.537ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73942024-08-16T07:22:21.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73952024-08-16T07:22:21.538ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 256.81469ms iteration = 12 status = null
73962024-08-16T07:22:21.559ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 278.01264ms iteration = 12 status = {}
73972024-08-16T07:22:21.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73982024-08-16T07:22:21.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73992024-08-16T07:22:21.604ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
74002024-08-16T07:22:21.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74012024-08-16T07:22:21.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74022024-08-16T07:22:21.611ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
74032024-08-16T07:22:21.611ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ea397313-d0bb-4ae8-9d98-0f7a7371d968", "content-length": "121", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
74042024-08-16T07:22:21.611ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
74052024-08-16T07:22:21.611ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
74062024-08-16T07:22:21.612ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
74072024-08-16T07:22:21.612ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
74082024-08-16T07:22:21.612ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
74092024-08-16T07:22:21.612ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
74102024-08-16T07:22:21.612ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
74112024-08-16T07:22:21.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74122024-08-16T07:22:21.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74132024-08-16T07:22:21.614ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74142024-08-16T07:22:21.614ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3e28a22c-eb55-4430-866c-3f99329b0c1f", "content-length": "2", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
74152024-08-16T07:22:21.614ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74162024-08-16T07:22:21.614ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d903ed7-35ed-4f5a-966c-299e02267312", "content-length": "52", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
74172024-08-16T07:22:21.614ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
74182024-08-16T07:22:21.614ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74192024-08-16T07:22:21.666ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b3b76b91-3bef-411f-b8b0-17382adea438", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
74202024-08-16T07:22:21.666ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
74212024-08-16T07:22:21.666ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74222024-08-16T07:22:21.667ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d0b46a3f-6d0a-40a0-882e-c180a7a4aa31", "content-length": "494", "date": "Fri, 16 Aug 2024 07:22:21 GMT"} })
74232024-08-16T07:22:21.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74242024-08-16T07:22:21.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74252024-08-16T07:22:21.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74262024-08-16T07:22:21.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74272024-08-16T07:22:21.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74282024-08-16T07:22:21.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74292024-08-16T07:22:21.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74302024-08-16T07:22:21.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74312024-08-16T07:22:21.681ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 400.181211ms iteration = 12 status = {}
74322024-08-16T07:22:23.119ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1298 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = d3c69eef-6162-4fe3-a7a5-5f624278ac0d response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
74332024-08-16T07:22:23.752ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:58339
74342024-08-16T07:22:23.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58339 req_id = 0965e9eb-3b29-4a83-993c-c354860b0084 roles = RoleSet { roles: {} } uri = /metrics/producers
74352024-08-16T07:22:23.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58339 req_id = 0965e9eb-3b29-4a83-993c-c354860b0084 resource = Database result = Ok(()) uri = /metrics/producers
74362024-08-16T07:22:23.784ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
74372024-08-16T07:22:23.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58339 req_id = 0965e9eb-3b29-4a83-993c-c354860b0084 roles = RoleSet { roles: {} } uri = /metrics/producers
74382024-08-16T07:22:23.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58339 req_id = 0965e9eb-3b29-4a83-993c-c354860b0084 resource = Database result = Ok(()) uri = /metrics/producers
74392024-08-16T07:22:23.791ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
74402024-08-16T07:22:23.792ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d5f3ef1a-7bb7-4926-9b71-edad2b2a0faf", "date": "Fri, 16 Aug 2024 07:22:23 GMT"} })
74412024-08-16T07:22:23.792ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 48a86640-720d-4ca7-a9c7-97a8f5a86939
74422024-08-16T07:22:23.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 40741 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58339 req_id = 0965e9eb-3b29-4a83-993c-c354860b0084 response_code = 201 uri = /metrics/producers
74432024-08-16T07:22:31.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
74442024-08-16T07:22:31.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74452024-08-16T07:22:31.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74462024-08-16T07:22:31.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74472024-08-16T07:22:31.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
74482024-08-16T07:22:31.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
74492024-08-16T07:22:31.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74502024-08-16T07:22:31.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74512024-08-16T07:22:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74522024-08-16T07:22:31.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74532024-08-16T07:22:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74542024-08-16T07:22:31.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74552024-08-16T07:22:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74562024-08-16T07:22:31.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74572024-08-16T07:22:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74582024-08-16T07:22:31.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74592024-08-16T07:22:31.287ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
74602024-08-16T07:22:31.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.352367ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74612024-08-16T07:22:31.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
74622024-08-16T07:22:31.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74632024-08-16T07:22:31.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74642024-08-16T07:22:31.294ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
74652024-08-16T07:22:31.294ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.064835ms iteration = 35 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
74662024-08-16T07:22:32.416ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:65003
74672024-08-16T07:22:32.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65003 req_id = cac348e9-cbea-46c7-923e-94fbbbf4bde8 roles = RoleSet { roles: {} } uri = /metrics/producers
74682024-08-16T07:22:32.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65003 req_id = cac348e9-cbea-46c7-923e-94fbbbf4bde8 resource = Database result = Ok(()) uri = /metrics/producers
74692024-08-16T07:22:32.450ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
74702024-08-16T07:22:32.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65003 req_id = cac348e9-cbea-46c7-923e-94fbbbf4bde8 roles = RoleSet { roles: {} } uri = /metrics/producers
74712024-08-16T07:22:32.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65003 req_id = cac348e9-cbea-46c7-923e-94fbbbf4bde8 resource = Database result = Ok(()) uri = /metrics/producers
74722024-08-16T07:22:32.458ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
74732024-08-16T07:22:32.458ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "992edb4f-36eb-4f99-b305-9233e837ca76", "date": "Fri, 16 Aug 2024 07:22:32 GMT"} })
74742024-08-16T07:22:32.458ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 89fb4a58-54f1-4b77-bc54-dd764b735a68
74752024-08-16T07:22:32.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 42972 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:65003 req_id = cac348e9-cbea-46c7-923e-94fbbbf4bde8 response_code = 201 uri = /metrics/producers
74762024-08-16T07:22:33.120ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1305 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = df0e591a-3a2d-4fc7-801b-4505ad219c30 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
74772024-08-16T07:22:41.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
74782024-08-16T07:22:41.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74792024-08-16T07:22:41.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74802024-08-16T07:22:41.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
74812024-08-16T07:22:41.282ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
74822024-08-16T07:22:41.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74832024-08-16T07:22:41.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74842024-08-16T07:22:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74852024-08-16T07:22:41.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74862024-08-16T07:22:41.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74872024-08-16T07:22:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74882024-08-16T07:22:41.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74892024-08-16T07:22:41.285ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
74902024-08-16T07:22:41.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.923457ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74912024-08-16T07:22:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74922024-08-16T07:22:41.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74932024-08-16T07:22:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74942024-08-16T07:22:41.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74952024-08-16T07:22:41.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
74962024-08-16T07:22:41.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74972024-08-16T07:22:41.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74982024-08-16T07:22:41.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
74992024-08-16T07:22:41.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.978156ms iteration = 36 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
75002024-08-16T07:22:43.120ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 88ee58a9-01bd-4c9e-8c7c-9724379b2c90 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
75012024-08-16T07:22:47.090ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:46836
75022024-08-16T07:22:47.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46836 req_id = c486a40d-84b3-4d09-a412-63ec28abc023 roles = RoleSet { roles: {} } uri = /metrics/producers
75032024-08-16T07:22:47.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46836 req_id = c486a40d-84b3-4d09-a412-63ec28abc023 resource = Database result = Ok(()) uri = /metrics/producers
75042024-08-16T07:22:47.122ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
75052024-08-16T07:22:47.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46836 req_id = c486a40d-84b3-4d09-a412-63ec28abc023 roles = RoleSet { roles: {} } uri = /metrics/producers
75062024-08-16T07:22:47.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46836 req_id = c486a40d-84b3-4d09-a412-63ec28abc023 resource = Database result = Ok(()) uri = /metrics/producers
75072024-08-16T07:22:47.127ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
75082024-08-16T07:22:47.128ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8a4a1f22-e929-42f3-be4d-e35662f8bafa", "date": "Fri, 16 Aug 2024 07:22:47 GMT"} })
75092024-08-16T07:22:47.128ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 911a2faf-c618-4671-9845-24941ebe21a2
75102024-08-16T07:22:47.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 39458 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46836 req_id = c486a40d-84b3-4d09-a412-63ec28abc023 response_code = 201 uri = /metrics/producers
75112024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
75122024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
75132024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75142024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
75152024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
75162024-08-16T07:22:51.280ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:12:51.280699498 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
75172024-08-16T07:22:51.280ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
75182024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
75192024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
75202024-08-16T07:22:51.280ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
75212024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
75222024-08-16T07:22:51.280ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
75232024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.86\u{b5}s iteration = 8 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
75242024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75252024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
75262024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
75272024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75282024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
75292024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75302024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
75312024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
75322024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
75332024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75342024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
75352024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75362024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
75372024-08-16T07:22:51.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75382024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75392024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
75402024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
75412024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75422024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
75432024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
75442024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
75452024-08-16T07:22:51.281ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
75462024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75472024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75482024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
75492024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
75502024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
75512024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75522024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75532024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75542024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75552024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75562024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75572024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
75582024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75592024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75602024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75612024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75622024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75632024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75642024-08-16T07:22:51.281ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 658486483 } })
75652024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75662024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75672024-08-16T07:22:51.281ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 658493833 } })
75682024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75692024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75702024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75712024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75722024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75732024-08-16T07:22:51.281ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75742024-08-16T07:22:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75752024-08-16T07:22:51.282ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75762024-08-16T07:22:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75772024-08-16T07:22:51.282ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
75782024-08-16T07:22:51.282ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75792024-08-16T07:22:51.282ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75802024-08-16T07:22:51.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
75812024-08-16T07:22:51.282ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
75822024-08-16T07:22:51.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75832024-08-16T07:22:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75842024-08-16T07:22:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75852024-08-16T07:22:51.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75862024-08-16T07:22:51.283ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75872024-08-16T07:22:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75882024-08-16T07:22:51.283ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
75892024-08-16T07:22:51.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.991479ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
75902024-08-16T07:22:51.283ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
75912024-08-16T07:22:51.283ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 660869468 } })
75922024-08-16T07:22:51.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.166723ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
75932024-08-16T07:22:51.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75942024-08-16T07:22:51.284ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75952024-08-16T07:22:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75962024-08-16T07:22:51.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75972024-08-16T07:22:51.284ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:12:51.280699498 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
75982024-08-16T07:22:51.284ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.913641ms iteration = 7 status = {"expiration":"2024-08-16T07:12:51.280699498Z","pruned":[]}
75992024-08-16T07:22:51.284ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
76002024-08-16T07:22:51.284ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
76012024-08-16T07:22:51.284ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.222217ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76022024-08-16T07:22:51.285ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76032024-08-16T07:22:51.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76042024-08-16T07:22:51.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76052024-08-16T07:22:51.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76062024-08-16T07:22:51.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76072024-08-16T07:22:51.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 663780515 } })
76082024-08-16T07:22:51.287ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
76092024-08-16T07:22:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76102024-08-16T07:22:51.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76112024-08-16T07:22:51.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76122024-08-16T07:22:51.287ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
76132024-08-16T07:22:51.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76142024-08-16T07:22:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76152024-08-16T07:22:51.287ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76162024-08-16T07:22:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76172024-08-16T07:22:51.288ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76182024-08-16T07:22:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76192024-08-16T07:22:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76202024-08-16T07:22:51.288ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76212024-08-16T07:22:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76222024-08-16T07:22:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76232024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76242024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
76252024-08-16T07:22:51.289ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
76262024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
76272024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76282024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
76292024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76302024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
76312024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76322024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76332024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76342024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76352024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76362024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76372024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76382024-08-16T07:22:51.289ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
76392024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 7.259607ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76402024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76412024-08-16T07:22:51.289ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
76422024-08-16T07:22:51.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 9.252604ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
76432024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76442024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76452024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76462024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76472024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76482024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
76492024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
76502024-08-16T07:22:51.290ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
76512024-08-16T07:22:51.290ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
76522024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
76532024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76542024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
76552024-08-16T07:22:51.290ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
76562024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76572024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
76582024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
76592024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
76602024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76612024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
76622024-08-16T07:22:51.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76632024-08-16T07:22:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76642024-08-16T07:22:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76652024-08-16T07:22:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76662024-08-16T07:22:51.291ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 668548525 } })
76672024-08-16T07:22:51.292ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
76682024-08-16T07:22:51.292ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
76692024-08-16T07:22:51.292ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
76702024-08-16T07:22:51.292ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76712024-08-16T07:22:51.292ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
76722024-08-16T07:22:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76732024-08-16T07:22:51.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76742024-08-16T07:22:51.293ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76752024-08-16T07:22:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76762024-08-16T07:22:51.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76772024-08-16T07:22:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76782024-08-16T07:22:51.293ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76792024-08-16T07:22:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76802024-08-16T07:22:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76812024-08-16T07:22:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76822024-08-16T07:22:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
76832024-08-16T07:22:51.294ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76842024-08-16T07:22:51.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76852024-08-16T07:22:51.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76862024-08-16T07:22:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76872024-08-16T07:22:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76882024-08-16T07:22:51.298ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76892024-08-16T07:22:51.299ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
76902024-08-16T07:22:51.299ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.154982ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
76912024-08-16T07:22:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76922024-08-16T07:22:51.300ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76932024-08-16T07:22:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76942024-08-16T07:22:51.302ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
76952024-08-16T07:22:51.302ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.179651ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
76962024-08-16T07:22:51.302ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76972024-08-16T07:22:51.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76982024-08-16T07:22:51.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76992024-08-16T07:22:51.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77002024-08-16T07:22:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77012024-08-16T07:22:51.305ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
77022024-08-16T07:22:51.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 14.743741ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
77032024-08-16T07:22:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77042024-08-16T07:22:51.305ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77052024-08-16T07:22:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77062024-08-16T07:22:51.305ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77072024-08-16T07:22:51.306ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77082024-08-16T07:22:51.306ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.486033ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77092024-08-16T07:22:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77102024-08-16T07:22:51.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77112024-08-16T07:22:51.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77122024-08-16T07:22:51.307ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
77132024-08-16T07:22:51.307ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
77142024-08-16T07:22:51.307ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 17.945205ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
77152024-08-16T07:22:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77162024-08-16T07:22:51.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77172024-08-16T07:22:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77182024-08-16T07:22:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77192024-08-16T07:22:51.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77202024-08-16T07:22:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77212024-08-16T07:22:51.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77222024-08-16T07:22:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77232024-08-16T07:22:51.308ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77242024-08-16T07:22:51.308ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
77252024-08-16T07:22:51.308ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
77262024-08-16T07:22:51.308ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 27.927795ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
77272024-08-16T07:22:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77282024-08-16T07:22:51.308ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77292024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77302024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77312024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
77322024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
77332024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77342024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77352024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77362024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
77372024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
77382024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77392024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77402024-08-16T07:22:51.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77412024-08-16T07:22:51.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77422024-08-16T07:22:51.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77432024-08-16T07:22:51.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77442024-08-16T07:22:51.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77452024-08-16T07:22:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77462024-08-16T07:22:51.313ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77472024-08-16T07:22:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77482024-08-16T07:22:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
77492024-08-16T07:22:51.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77502024-08-16T07:22:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
77512024-08-16T07:22:51.313ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77522024-08-16T07:22:51.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77532024-08-16T07:22:51.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77542024-08-16T07:22:51.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77552024-08-16T07:22:51.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77562024-08-16T07:22:51.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77572024-08-16T07:22:51.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77582024-08-16T07:22:51.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77592024-08-16T07:22:51.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77602024-08-16T07:22:51.315ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77612024-08-16T07:22:51.316ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77622024-08-16T07:22:51.316ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
77632024-08-16T07:22:51.316ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
77642024-08-16T07:22:51.316ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
77652024-08-16T07:22:51.316ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 35.889579ms iteration = 8 status = {"generation":1}
77662024-08-16T07:22:51.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77672024-08-16T07:22:51.317ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77682024-08-16T07:22:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
77692024-08-16T07:22:51.317ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
77702024-08-16T07:22:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
77712024-08-16T07:22:51.318ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 37.974207ms iteration = 4 status = {"nsuccess":5}
77722024-08-16T07:22:51.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77732024-08-16T07:22:51.319ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77742024-08-16T07:22:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77752024-08-16T07:22:51.319ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
77762024-08-16T07:22:51.319ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
77772024-08-16T07:22:51.319ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
77782024-08-16T07:22:51.319ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 38.903658ms iteration = 8 status = {"generation":2}
77792024-08-16T07:22:51.321ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
77802024-08-16T07:22:51.321ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.327631ms iteration = 37 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
77812024-08-16T07:22:51.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77822024-08-16T07:22:51.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77832024-08-16T07:22:51.328ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77842024-08-16T07:22:51.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77852024-08-16T07:22:51.329ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77862024-08-16T07:22:51.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
77872024-08-16T07:22:51.331ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77882024-08-16T07:22:51.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77892024-08-16T07:22:51.332ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 52.008562ms iteration = 13 status = 0
77902024-08-16T07:22:51.333ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
77912024-08-16T07:22:51.333ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77922024-08-16T07:22:51.333ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77932024-08-16T07:22:51.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77942024-08-16T07:22:51.335ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
77952024-08-16T07:22:51.335ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77962024-08-16T07:22:51.335ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 46.108275ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
77972024-08-16T07:22:51.336ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77982024-08-16T07:22:51.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77992024-08-16T07:22:51.344ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78002024-08-16T07:22:51.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78012024-08-16T07:22:51.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78022024-08-16T07:22:51.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78032024-08-16T07:22:51.347ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78042024-08-16T07:22:51.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78052024-08-16T07:22:51.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78062024-08-16T07:22:51.349ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
78072024-08-16T07:22:51.349ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 68.370599ms iteration = 15 status = {"physical_disks_added":0}
78082024-08-16T07:22:51.349ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78092024-08-16T07:22:51.349ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78102024-08-16T07:22:51.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78112024-08-16T07:22:51.360ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) }
78122024-08-16T07:22:51.360ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 79.549297ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
78132024-08-16T07:22:51.484ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
78142024-08-16T07:22:51.486ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
78152024-08-16T07:22:51.486ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78162024-08-16T07:22:51.487ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "04dbe6d9-49aa-4095-8af6-7be06472ba5c", "content-length": "26", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
78172024-08-16T07:22:51.487ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78182024-08-16T07:22:51.489ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78192024-08-16T07:22:51.496ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
78202024-08-16T07:22:51.496ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78212024-08-16T07:22:51.497ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ecb14e10-4ccc-4e6b-aaf8-0b9a5c7fe1e2", "content-length": "26", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
78222024-08-16T07:22:51.497ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78232024-08-16T07:22:51.498ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
78242024-08-16T07:22:51.623ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78252024-08-16T07:22:51.623ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8a873784-015c-4d20-9272-ac7fb1ccc74f", "content-length": "372", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
78262024-08-16T07:22:51.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78272024-08-16T07:22:51.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78282024-08-16T07:22:51.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78292024-08-16T07:22:51.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78302024-08-16T07:22:51.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78312024-08-16T07:22:51.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78322024-08-16T07:22:51.631ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78332024-08-16T07:22:51.631ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "445dc84e-2fbf-4dc1-8093-3604623c169a", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
78342024-08-16T07:22:51.632ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 343.41537ms iteration = 14 status = {}
78352024-08-16T07:22:51.680ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
78362024-08-16T07:22:51.680ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dd54fd40-24d7-4971-ac4e-623953340f52", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78372024-08-16T07:22:51.680ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78382024-08-16T07:22:51.682ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ed4a6bef-fe05-4e0d-8e1a-efdf64642316", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78392024-08-16T07:22:51.682ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78402024-08-16T07:22:51.683ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78412024-08-16T07:22:51.683ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 403.035057ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
78422024-08-16T07:22:51.687ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
78432024-08-16T07:22:51.687ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78442024-08-16T07:22:51.687ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bb25f254-20ca-4385-acfd-853e2e15b4a5", "content-length": "26", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
78452024-08-16T07:22:51.687ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78462024-08-16T07:22:51.688ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78472024-08-16T07:22:51.688ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b0f64b8a-3b18-467c-a434-9d37afdf6e48", "content-length": "691", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
78482024-08-16T07:22:51.688ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
78492024-08-16T07:22:51.688ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
78502024-08-16T07:22:51.688ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
78512024-08-16T07:22:51.689ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78522024-08-16T07:22:51.690ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 409.509847ms iteration = 13 status = {}
78532024-08-16T07:22:51.701ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
78542024-08-16T07:22:51.806ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 525.384823ms iteration = 13 status = {}
78552024-08-16T07:22:51.891ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78562024-08-16T07:22:51.891ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9746af0c-a0e1-4a4e-a667-a4ca268a2de5", "content-length": "1", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
78572024-08-16T07:22:51.893ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78582024-08-16T07:22:51.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78592024-08-16T07:22:51.895ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 614.334357ms iteration = 13 status = null
78602024-08-16T07:22:51.952ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
78612024-08-16T07:22:52.088ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
78622024-08-16T07:22:52.089ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bbd9ab83-aacc-4d9d-a9f3-4e1d0787c204", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
78632024-08-16T07:22:52.089ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
78642024-08-16T07:22:52.091ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f0e0ccbe-a192-4806-8103-acdc4701ac3d", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
78652024-08-16T07:22:52.091ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
78662024-08-16T07:22:52.092ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ae090782-ed0d-4280-80ad-7eab0bafb6d2", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
78672024-08-16T07:22:52.092ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
78682024-08-16T07:22:52.094ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
78692024-08-16T07:22:52.094ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 813.945277ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
78702024-08-16T07:22:52.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78712024-08-16T07:22:52.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78722024-08-16T07:22:52.102ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
78732024-08-16T07:22:52.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78742024-08-16T07:22:52.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78752024-08-16T07:22:52.108ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78762024-08-16T07:22:52.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8d7a70a3-abc3-407a-ae85-935496013a90", "content-length": "121", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
78772024-08-16T07:22:52.108ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
78782024-08-16T07:22:52.108ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
78792024-08-16T07:22:52.109ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
78802024-08-16T07:22:52.109ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
78812024-08-16T07:22:52.109ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
78822024-08-16T07:22:52.109ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
78832024-08-16T07:22:52.109ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
78842024-08-16T07:22:52.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78852024-08-16T07:22:52.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78862024-08-16T07:22:52.111ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78872024-08-16T07:22:52.111ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a530496d-0ce3-4787-bf6b-c66e1748e4a5", "content-length": "2", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
78882024-08-16T07:22:52.111ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78892024-08-16T07:22:52.111ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "538458c6-0075-432a-800f-5d21ccc7c71f", "content-length": "52", "date": "Fri, 16 Aug 2024 07:22:51 GMT"} })
78902024-08-16T07:22:52.112ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
78912024-08-16T07:22:52.112ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78922024-08-16T07:22:52.159ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4c6a86ff-798b-4bc5-966b-9431212621ab", "date": "Fri, 16 Aug 2024 07:22:52 GMT"} })
78932024-08-16T07:22:52.159ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
78942024-08-16T07:22:52.159ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78952024-08-16T07:22:52.159ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c66b47c3-b63c-4fd9-b02d-20ad99059d81", "content-length": "494", "date": "Fri, 16 Aug 2024 07:22:52 GMT"} })
78962024-08-16T07:22:52.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78972024-08-16T07:22:52.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78982024-08-16T07:22:52.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78992024-08-16T07:22:52.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79002024-08-16T07:22:52.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79012024-08-16T07:22:52.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79022024-08-16T07:22:52.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79032024-08-16T07:22:52.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79042024-08-16T07:22:52.173ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 892.991763ms iteration = 13 status = {}
79052024-08-16T07:22:52.620ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:37848
79062024-08-16T07:22:52.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37848 req_id = 40563241-04bd-497b-a2c4-b33e0d514b5f roles = RoleSet { roles: {} } uri = /metrics/producers
79072024-08-16T07:22:52.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37848 req_id = 40563241-04bd-497b-a2c4-b33e0d514b5f resource = Database result = Ok(()) uri = /metrics/producers
79082024-08-16T07:22:52.653ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
79092024-08-16T07:22:52.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37848 req_id = 40563241-04bd-497b-a2c4-b33e0d514b5f roles = RoleSet { roles: {} } uri = /metrics/producers
79102024-08-16T07:22:52.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37848 req_id = 40563241-04bd-497b-a2c4-b33e0d514b5f resource = Database result = Ok(()) uri = /metrics/producers
79112024-08-16T07:22:52.659ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
79122024-08-16T07:22:52.659ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4abab535-81d9-4ec7-bfc5-ce9509bb6792", "date": "Fri, 16 Aug 2024 07:22:52 GMT"} })
79132024-08-16T07:22:52.659ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = b9b5cfb7-1d99-4535-948c-195d99b3bf69
79142024-08-16T07:22:52.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 41675 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37848 req_id = 40563241-04bd-497b-a2c4-b33e0d514b5f response_code = 201 uri = /metrics/producers
79152024-08-16T07:22:53.120ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1330 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = bdf3c344-b349-40f0-a8c8-066c4845b629 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
79162024-08-16T07:23:01.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
79172024-08-16T07:23:01.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79182024-08-16T07:23:01.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79192024-08-16T07:23:01.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
79202024-08-16T07:23:01.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
79212024-08-16T07:23:01.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79222024-08-16T07:23:01.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79232024-08-16T07:23:01.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79242024-08-16T07:23:01.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79252024-08-16T07:23:01.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79262024-08-16T07:23:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79272024-08-16T07:23:01.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79282024-08-16T07:23:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79292024-08-16T07:23:01.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
79302024-08-16T07:23:01.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.357227ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79312024-08-16T07:23:01.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79322024-08-16T07:23:01.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79332024-08-16T07:23:01.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79342024-08-16T07:23:01.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
79352024-08-16T07:23:01.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79362024-08-16T07:23:01.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79372024-08-16T07:23:01.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
79382024-08-16T07:23:01.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.985376ms iteration = 38 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
79392024-08-16T07:23:03.120ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1390 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 27b0fff5-345e-406a-a746-232ad3fd9e11 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
79402024-08-16T07:23:11.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
79412024-08-16T07:23:11.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79422024-08-16T07:23:11.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79432024-08-16T07:23:11.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79442024-08-16T07:23:11.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
79452024-08-16T07:23:11.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
79462024-08-16T07:23:11.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79472024-08-16T07:23:11.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79482024-08-16T07:23:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79492024-08-16T07:23:11.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79502024-08-16T07:23:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79512024-08-16T07:23:11.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79522024-08-16T07:23:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79532024-08-16T07:23:11.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79542024-08-16T07:23:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79552024-08-16T07:23:11.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
79562024-08-16T07:23:11.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.292645ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79572024-08-16T07:23:11.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79582024-08-16T07:23:11.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
79592024-08-16T07:23:11.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79602024-08-16T07:23:11.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79612024-08-16T07:23:11.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
79622024-08-16T07:23:11.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.500945ms iteration = 39 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
79632024-08-16T07:23:13.121ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = b21872af-36ec-4830-8071-3521eccd803a response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
79642024-08-16T07:23:21.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
79652024-08-16T07:23:21.280ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
79662024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79672024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
79682024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
79692024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79702024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
79712024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79722024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
79732024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
79742024-08-16T07:23:21.281ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
79752024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79762024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
79772024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
79782024-08-16T07:23:21.281ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
79792024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79802024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79812024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
79822024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79832024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79842024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79852024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79862024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79872024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79882024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79892024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79902024-08-16T07:23:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79912024-08-16T07:23:21.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79922024-08-16T07:23:21.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
79932024-08-16T07:23:21.283ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
79942024-08-16T07:23:21.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
79952024-08-16T07:23:21.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79962024-08-16T07:23:21.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79972024-08-16T07:23:21.283ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79982024-08-16T07:23:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79992024-08-16T07:23:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80002024-08-16T07:23:21.283ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1464, tv_nsec: 660741198 } })
80012024-08-16T07:23:21.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80022024-08-16T07:23:21.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80032024-08-16T07:23:21.284ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
80042024-08-16T07:23:21.284ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.534961ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80052024-08-16T07:23:21.284ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
80062024-08-16T07:23:21.284ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80072024-08-16T07:23:21.284ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1464, tv_nsec: 661973606 } })
80082024-08-16T07:23:21.285ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
80092024-08-16T07:23:21.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80102024-08-16T07:23:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80112024-08-16T07:23:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80122024-08-16T07:23:21.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80132024-08-16T07:23:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80142024-08-16T07:23:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80152024-08-16T07:23:21.286ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80162024-08-16T07:23:21.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
80172024-08-16T07:23:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80182024-08-16T07:23:21.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.752877ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80192024-08-16T07:23:21.287ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1464, tv_nsec: 664886664 } })
80202024-08-16T07:23:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80212024-08-16T07:23:21.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80222024-08-16T07:23:21.287ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
80232024-08-16T07:23:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80242024-08-16T07:23:21.288ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
80252024-08-16T07:23:21.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80262024-08-16T07:23:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80272024-08-16T07:23:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80282024-08-16T07:23:21.288ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80292024-08-16T07:23:21.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80302024-08-16T07:23:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80312024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80322024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80332024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80342024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80352024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80362024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
80372024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
80382024-08-16T07:23:21.289ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
80392024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80402024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80412024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
80422024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80432024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80442024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
80452024-08-16T07:23:21.289ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
80462024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
80472024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80482024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80492024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80502024-08-16T07:23:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80512024-08-16T07:23:21.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80522024-08-16T07:23:21.291ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
80532024-08-16T07:23:21.291ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.556576ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
80542024-08-16T07:23:21.291ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80552024-08-16T07:23:21.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80562024-08-16T07:23:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80572024-08-16T07:23:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80582024-08-16T07:23:21.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80592024-08-16T07:23:21.291ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
80602024-08-16T07:23:21.292ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80612024-08-16T07:23:21.292ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80622024-08-16T07:23:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80632024-08-16T07:23:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80642024-08-16T07:23:21.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80652024-08-16T07:23:21.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80662024-08-16T07:23:21.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80672024-08-16T07:23:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80682024-08-16T07:23:21.293ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
80692024-08-16T07:23:21.293ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80702024-08-16T07:23:21.293ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 4.231828ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
80712024-08-16T07:23:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80722024-08-16T07:23:21.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80732024-08-16T07:23:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
80742024-08-16T07:23:21.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80752024-08-16T07:23:21.294ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80762024-08-16T07:23:21.294ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 11.573198ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
80772024-08-16T07:23:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80782024-08-16T07:23:21.294ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
80792024-08-16T07:23:21.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.541568ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
80802024-08-16T07:23:21.295ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80812024-08-16T07:23:21.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80822024-08-16T07:23:21.297ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80832024-08-16T07:23:21.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80842024-08-16T07:23:21.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80852024-08-16T07:23:21.298ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
80862024-08-16T07:23:21.298ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 17.125376ms iteration = 16 status = {"physical_disks_added":0}
80872024-08-16T07:23:21.300ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
80882024-08-16T07:23:21.300ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.757326ms iteration = 40 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
80892024-08-16T07:23:21.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80902024-08-16T07:23:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80912024-08-16T07:23:21.302ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80922024-08-16T07:23:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80932024-08-16T07:23:21.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80942024-08-16T07:23:21.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80952024-08-16T07:23:21.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80962024-08-16T07:23:21.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80972024-08-16T07:23:21.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80982024-08-16T07:23:21.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80992024-08-16T07:23:21.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81002024-08-16T07:23:21.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81012024-08-16T07:23:21.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81022024-08-16T07:23:21.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81032024-08-16T07:23:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
81042024-08-16T07:23:21.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81052024-08-16T07:23:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81062024-08-16T07:23:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81072024-08-16T07:23:21.309ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 28.547919ms iteration = 14 status = 0
81082024-08-16T07:23:21.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81092024-08-16T07:23:21.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81102024-08-16T07:23:21.312ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
81112024-08-16T07:23:21.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 31.561339ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
81122024-08-16T07:23:21.439ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
81132024-08-16T07:23:21.439ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81142024-08-16T07:23:21.440ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f8f32df2-f5ae-4b9b-b1e2-af07d1fd50c4", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
81152024-08-16T07:23:21.440ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81162024-08-16T07:23:21.441ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81172024-08-16T07:23:21.543ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
81182024-08-16T07:23:21.543ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81192024-08-16T07:23:21.543ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "861b29dc-ab16-4107-bc2c-ed86f85ec1cd", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
81202024-08-16T07:23:21.544ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81212024-08-16T07:23:21.546ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81222024-08-16T07:23:21.550ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
81232024-08-16T07:23:21.550ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81242024-08-16T07:23:21.550ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d182f2e6-8444-4bb1-841d-9e2387036f55", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
81252024-08-16T07:23:21.550ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81262024-08-16T07:23:21.552ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
81272024-08-16T07:23:21.574ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81282024-08-16T07:23:21.575ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8abd394e-20bf-4257-a4c5-ca45ba2d1144", "content-length": "372", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
81292024-08-16T07:23:21.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81302024-08-16T07:23:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81312024-08-16T07:23:21.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81322024-08-16T07:23:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81332024-08-16T07:23:21.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81342024-08-16T07:23:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81352024-08-16T07:23:21.584ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81362024-08-16T07:23:21.584ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e8224ff0-8e4e-4a68-9844-714bb7c9761c", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
81372024-08-16T07:23:21.586ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.789884ms iteration = 15 status = {}
81382024-08-16T07:23:21.628ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81392024-08-16T07:23:21.629ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "283d00c9-c17f-467f-9ee2-87f369b74002", "content-length": "691", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
81402024-08-16T07:23:21.629ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
81412024-08-16T07:23:21.629ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
81422024-08-16T07:23:21.629ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
81432024-08-16T07:23:21.631ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 350.083945ms iteration = 14 status = {}
81442024-08-16T07:23:21.667ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 386.912275ms iteration = 14 status = {}
81452024-08-16T07:23:21.714ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81462024-08-16T07:23:21.714ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b20545cc-b996-456d-85b4-90ebc7da1b4e", "content-length": "1", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
81472024-08-16T07:23:21.718ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81482024-08-16T07:23:21.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81492024-08-16T07:23:21.720ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 439.702095ms iteration = 14 status = null
81502024-08-16T07:23:21.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81512024-08-16T07:23:21.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81522024-08-16T07:23:21.815ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
81532024-08-16T07:23:21.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81542024-08-16T07:23:21.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81552024-08-16T07:23:21.826ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81562024-08-16T07:23:21.826ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d7be031-3264-41a7-a9ff-6f2f0d8f45b3", "content-length": "121", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
81572024-08-16T07:23:21.826ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
81582024-08-16T07:23:21.826ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
81592024-08-16T07:23:21.827ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
81602024-08-16T07:23:21.827ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
81612024-08-16T07:23:21.827ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
81622024-08-16T07:23:21.827ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
81632024-08-16T07:23:21.827ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
81642024-08-16T07:23:21.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81652024-08-16T07:23:21.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81662024-08-16T07:23:21.830ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81672024-08-16T07:23:21.830ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "96424842-c1df-4eb8-a079-89b1d9b68776", "content-length": "2", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
81682024-08-16T07:23:21.830ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81692024-08-16T07:23:21.830ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0bb802fa-625e-4774-ae5d-1b434b0aaafe", "content-length": "52", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
81702024-08-16T07:23:21.830ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
81712024-08-16T07:23:21.830ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81722024-08-16T07:23:21.881ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d34a8d1a-5645-4027-a2d8-d1ceb1d5179f", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
81732024-08-16T07:23:21.881ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
81742024-08-16T07:23:21.881ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81752024-08-16T07:23:21.881ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d6ea850-9f71-4900-b06a-f92295f756a3", "content-length": "494", "date": "Fri, 16 Aug 2024 07:23:21 GMT"} })
81762024-08-16T07:23:21.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81772024-08-16T07:23:21.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81782024-08-16T07:23:21.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81792024-08-16T07:23:21.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81802024-08-16T07:23:21.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81812024-08-16T07:23:21.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81822024-08-16T07:23:21.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81832024-08-16T07:23:21.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81842024-08-16T07:23:21.895ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 614.41986ms iteration = 14 status = {}
81852024-08-16T07:23:23.120ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1889 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = da2262e4-01b3-47b6-b821-0f08657b41d5 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
81862024-08-16T07:23:31.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
81872024-08-16T07:23:31.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81882024-08-16T07:23:31.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81892024-08-16T07:23:31.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
81902024-08-16T07:23:31.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
81912024-08-16T07:23:31.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81922024-08-16T07:23:31.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81932024-08-16T07:23:31.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81942024-08-16T07:23:31.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81952024-08-16T07:23:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81962024-08-16T07:23:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81972024-08-16T07:23:31.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81982024-08-16T07:23:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81992024-08-16T07:23:31.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
82002024-08-16T07:23:31.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.711076ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82012024-08-16T07:23:31.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82022024-08-16T07:23:31.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82032024-08-16T07:23:31.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82042024-08-16T07:23:31.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
82052024-08-16T07:23:31.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82062024-08-16T07:23:31.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82072024-08-16T07:23:31.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
82082024-08-16T07:23:31.297ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.767574ms iteration = 41 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
82092024-08-16T07:23:33.120ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1421 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 3d0abaae-f5fa-492c-868e-1fdb7de83c8b response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
82102024-08-16T07:23:41.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
82112024-08-16T07:23:41.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82122024-08-16T07:23:41.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82132024-08-16T07:23:41.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
82142024-08-16T07:23:41.282ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
82152024-08-16T07:23:41.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82162024-08-16T07:23:41.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82172024-08-16T07:23:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82182024-08-16T07:23:41.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82192024-08-16T07:23:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82202024-08-16T07:23:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82212024-08-16T07:23:41.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82222024-08-16T07:23:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82232024-08-16T07:23:41.287ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
82242024-08-16T07:23:41.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.731479ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82252024-08-16T07:23:41.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82262024-08-16T07:23:41.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82272024-08-16T07:23:41.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82282024-08-16T07:23:41.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
82292024-08-16T07:23:41.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82302024-08-16T07:23:41.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82312024-08-16T07:23:41.301ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
82322024-08-16T07:23:41.301ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.539045ms iteration = 42 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
82332024-08-16T07:23:43.120ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1499 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 85b1313d-bd26-4cab-917a-c72be6e4af2c response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
82342024-08-16T07:23:47.226ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:49773
82352024-08-16T07:23:47.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:49773 req_id = d4b4cd7c-2f31-45df-9227-47372b4a526c roles = RoleSet { roles: {} } uri = /metrics/producers
82362024-08-16T07:23:47.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:49773 req_id = d4b4cd7c-2f31-45df-9227-47372b4a526c resource = Database result = Ok(()) uri = /metrics/producers
82372024-08-16T07:23:47.264ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
82382024-08-16T07:23:47.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:49773 req_id = d4b4cd7c-2f31-45df-9227-47372b4a526c roles = RoleSet { roles: {} } uri = /metrics/producers
82392024-08-16T07:23:47.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:49773 req_id = d4b4cd7c-2f31-45df-9227-47372b4a526c resource = Database result = Ok(()) uri = /metrics/producers
82402024-08-16T07:23:47.270ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
82412024-08-16T07:23:47.270ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7a81be88-9e42-435d-9405-4af82ade1563", "date": "Fri, 16 Aug 2024 07:23:47 GMT"} })
82422024-08-16T07:23:47.270ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f
82432024-08-16T07:23:47.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 44636 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:49773 req_id = d4b4cd7c-2f31-45df-9227-47372b4a526c response_code = 201 uri = /metrics/producers
82442024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
82452024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
82462024-08-16T07:23:51.281ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
82472024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
82482024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
82492024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82502024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
82512024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
82522024-08-16T07:23:51.281ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
82532024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82542024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
82552024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
82562024-08-16T07:23:51.281ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
82572024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82582024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82592024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
82602024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
82612024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82622024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
82632024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82642024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
82652024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82662024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
82672024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
82682024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82692024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
82702024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
82712024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82722024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
82732024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82742024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
82752024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82762024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
82772024-08-16T07:23:51.281ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:13:51.281425958 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
82782024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
82792024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
82802024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
82812024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
82822024-08-16T07:23:51.281ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
82832024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.66\u{b5}s iteration = 9 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
82842024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
82852024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82862024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82872024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82882024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
82892024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
82902024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82912024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82922024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82932024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82942024-08-16T07:23:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82952024-08-16T07:23:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82962024-08-16T07:23:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82972024-08-16T07:23:51.282ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 659368810 } })
82982024-08-16T07:23:51.282ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 659384391 } })
82992024-08-16T07:23:51.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
83002024-08-16T07:23:51.282ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
83012024-08-16T07:23:51.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83022024-08-16T07:23:51.282ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
83032024-08-16T07:23:51.282ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83042024-08-16T07:23:51.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83052024-08-16T07:23:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83062024-08-16T07:23:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83072024-08-16T07:23:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83082024-08-16T07:23:51.283ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
83092024-08-16T07:23:51.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.462477ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
83102024-08-16T07:23:51.284ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:13:51.281425958 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
83112024-08-16T07:23:51.284ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.786804ms iteration = 8 status = {"expiration":"2024-08-16T07:13:51.281425958Z","pruned":[]}
83122024-08-16T07:23:51.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83132024-08-16T07:23:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83142024-08-16T07:23:51.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83152024-08-16T07:23:51.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83162024-08-16T07:23:51.286ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
83172024-08-16T07:23:51.286ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.795681ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83182024-08-16T07:23:51.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83192024-08-16T07:23:51.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83202024-08-16T07:23:51.286ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83212024-08-16T07:23:51.286ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
83222024-08-16T07:23:51.286ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.532238ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
83232024-08-16T07:23:51.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 664189442 } })
83242024-08-16T07:23:51.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 664194812 } })
83252024-08-16T07:23:51.287ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83262024-08-16T07:23:51.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
83272024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
83282024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83292024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83302024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
83312024-08-16T07:23:51.288ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
83322024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
83332024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
83342024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83352024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83362024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
83372024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83382024-08-16T07:23:51.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
83392024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83402024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
83412024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83422024-08-16T07:23:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83432024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83442024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83452024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83462024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
83472024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
83482024-08-16T07:23:51.289ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
83492024-08-16T07:23:51.289ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
83502024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
83512024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83522024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
83532024-08-16T07:23:51.289ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
83542024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83552024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83562024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
83572024-08-16T07:23:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83582024-08-16T07:23:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83592024-08-16T07:23:51.290ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83602024-08-16T07:23:51.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83612024-08-16T07:23:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83622024-08-16T07:23:51.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83632024-08-16T07:23:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83642024-08-16T07:23:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83652024-08-16T07:23:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
83662024-08-16T07:23:51.290ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83672024-08-16T07:23:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83682024-08-16T07:23:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83692024-08-16T07:23:51.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83702024-08-16T07:23:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83712024-08-16T07:23:51.291ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
83722024-08-16T07:23:51.291ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 9.986121ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
83732024-08-16T07:23:51.291ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83742024-08-16T07:23:51.291ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83752024-08-16T07:23:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83762024-08-16T07:23:51.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83772024-08-16T07:23:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83782024-08-16T07:23:51.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83792024-08-16T07:23:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83802024-08-16T07:23:51.291ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83812024-08-16T07:23:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83822024-08-16T07:23:51.292ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
83832024-08-16T07:23:51.292ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
83842024-08-16T07:23:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.064704ms iteration = 8 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
83852024-08-16T07:23:51.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83862024-08-16T07:23:51.292ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
83872024-08-16T07:23:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 10.471192ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83882024-08-16T07:23:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83892024-08-16T07:23:51.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83902024-08-16T07:23:51.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83912024-08-16T07:23:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83922024-08-16T07:23:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83932024-08-16T07:23:51.294ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83942024-08-16T07:23:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83952024-08-16T07:23:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
83962024-08-16T07:23:51.294ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83972024-08-16T07:23:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83982024-08-16T07:23:51.295ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83992024-08-16T07:23:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84002024-08-16T07:23:51.296ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
84012024-08-16T07:23:51.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.998741ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
84022024-08-16T07:23:51.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84032024-08-16T07:23:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84042024-08-16T07:23:51.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84052024-08-16T07:23:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84062024-08-16T07:23:51.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84072024-08-16T07:23:51.307ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
84082024-08-16T07:23:51.307ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.137619ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
84092024-08-16T07:23:51.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84102024-08-16T07:23:51.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84112024-08-16T07:23:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84122024-08-16T07:23:51.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84132024-08-16T07:23:51.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84142024-08-16T07:23:51.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84152024-08-16T07:23:51.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84162024-08-16T07:23:51.312ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84172024-08-16T07:23:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84182024-08-16T07:23:51.313ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
84192024-08-16T07:23:51.313ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
84202024-08-16T07:23:51.313ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
84212024-08-16T07:23:51.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84222024-08-16T07:23:51.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84232024-08-16T07:23:51.313ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84242024-08-16T07:23:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84252024-08-16T07:23:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84262024-08-16T07:23:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84272024-08-16T07:23:51.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84282024-08-16T07:23:51.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84292024-08-16T07:23:51.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84302024-08-16T07:23:51.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84312024-08-16T07:23:51.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84322024-08-16T07:23:51.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84332024-08-16T07:23:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
84342024-08-16T07:23:51.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84352024-08-16T07:23:51.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84362024-08-16T07:23:51.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84372024-08-16T07:23:51.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84382024-08-16T07:23:51.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84392024-08-16T07:23:51.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84402024-08-16T07:23:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
84412024-08-16T07:23:51.319ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84422024-08-16T07:23:51.319ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
84432024-08-16T07:23:51.319ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84442024-08-16T07:23:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84452024-08-16T07:23:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84462024-08-16T07:23:51.319ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84472024-08-16T07:23:51.319ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
84482024-08-16T07:23:51.319ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
84492024-08-16T07:23:51.319ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
84502024-08-16T07:23:51.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84512024-08-16T07:23:51.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84522024-08-16T07:23:51.320ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
84532024-08-16T07:23:51.320ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
84542024-08-16T07:23:51.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84552024-08-16T07:23:51.320ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 39.348449ms iteration = 15 status = 0
84562024-08-16T07:23:51.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84572024-08-16T07:23:51.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84582024-08-16T07:23:51.321ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84592024-08-16T07:23:51.321ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84602024-08-16T07:23:51.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84612024-08-16T07:23:51.321ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
84622024-08-16T07:23:51.321ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 32.03103ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
84632024-08-16T07:23:51.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84642024-08-16T07:23:51.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84652024-08-16T07:23:51.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84662024-08-16T07:23:51.323ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84672024-08-16T07:23:51.323ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
84682024-08-16T07:23:51.323ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.522522ms iteration = 43 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
84692024-08-16T07:23:51.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84702024-08-16T07:23:51.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84712024-08-16T07:23:51.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84722024-08-16T07:23:51.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84732024-08-16T07:23:51.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84742024-08-16T07:23:51.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84752024-08-16T07:23:51.326ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
84762024-08-16T07:23:51.326ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
84772024-08-16T07:23:51.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84782024-08-16T07:23:51.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84792024-08-16T07:23:51.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84802024-08-16T07:23:51.326ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
84812024-08-16T07:23:51.326ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
84822024-08-16T07:23:51.326ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 45.455569ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
84832024-08-16T07:23:51.327ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
84842024-08-16T07:23:51.327ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84852024-08-16T07:23:51.327ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84862024-08-16T07:23:51.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84872024-08-16T07:23:51.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84882024-08-16T07:23:51.328ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
84892024-08-16T07:23:51.328ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
84902024-08-16T07:23:51.328ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
84912024-08-16T07:23:51.328ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 47.333743ms iteration = 9 status = {"generation":1}
84922024-08-16T07:23:51.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84932024-08-16T07:23:51.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84942024-08-16T07:23:51.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84952024-08-16T07:23:51.331ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
84962024-08-16T07:23:51.331ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84972024-08-16T07:23:51.331ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 43.075335ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
84982024-08-16T07:23:51.332ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
84992024-08-16T07:23:51.332ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
85002024-08-16T07:23:51.332ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
85012024-08-16T07:23:51.332ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 50.801383ms iteration = 9 status = {"generation":2}
85022024-08-16T07:23:51.360ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
85032024-08-16T07:23:51.360ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 79.337063ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
85042024-08-16T07:23:51.366ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
85052024-08-16T07:23:51.366ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 84.610545ms iteration = 17 status = {"physical_disks_added":0}
85062024-08-16T07:23:51.448ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
85072024-08-16T07:23:51.480ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f/state
85082024-08-16T07:23:51.480ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/instances/1a5c861f-b142-4554-9da6-cdc902ef7a3f/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a89f1985-10b0-4558-9ea4-04dd74fa1230", "content-length": "183", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
85092024-08-16T07:23:51.480ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f state = Running
85102024-08-16T07:23:51.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85112024-08-16T07:23:51.483ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85122024-08-16T07:23:51.483ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85132024-08-16T07:23:51.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85142024-08-16T07:23:51.483ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1846 instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0cf6e496-975f-45c7-be02-aad19df20905 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-16T07:23:47.235929007Z }
85152024-08-16T07:23:51.483ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f roles = RoleSet { roles: {} }
85162024-08-16T07:23:51.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 1a5c861f-b142-4554-9da6-cdc902ef7a3f resource = Database result = Ok(())
85172024-08-16T07:23:51.491ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
85182024-08-16T07:23:51.491ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 209.186111ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
85192024-08-16T07:23:51.500ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85202024-08-16T07:23:51.501ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ed3b76b9-e5e9-40c4-b03b-316b8ed149b7", "content-length": "809", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
85212024-08-16T07:23:51.501ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 250, 109, 178])), vni: Vni(941973) }} sled = sock
85222024-08-16T07:23:51.501ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
85232024-08-16T07:23:51.501ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
85242024-08-16T07:23:51.502ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 879584406 } })
85252024-08-16T07:23:51.502ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
85262024-08-16T07:23:51.503ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 222.090748ms iteration = 15 status = {}
85272024-08-16T07:23:51.619ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
85282024-08-16T07:23:51.619ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1332802b-7a3a-4a60-bdd5-47a618f3eceb", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85292024-08-16T07:23:51.619ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85302024-08-16T07:23:51.621ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "538065de-b84c-4e4d-8997-075816ebdd36", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85312024-08-16T07:23:51.621ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85322024-08-16T07:23:51.622ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85332024-08-16T07:23:51.622ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 341.525177ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
85342024-08-16T07:23:51.647ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85352024-08-16T07:23:51.648ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b844e97e-fb44-4e99-acad-77328d17f697", "content-length": "581", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
85362024-08-16T07:23:51.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85372024-08-16T07:23:51.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85382024-08-16T07:23:51.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85392024-08-16T07:23:51.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85402024-08-16T07:23:51.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85412024-08-16T07:23:51.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85422024-08-16T07:23:51.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85432024-08-16T07:23:51.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85442024-08-16T07:23:51.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85452024-08-16T07:23:51.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85462024-08-16T07:23:51.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85472024-08-16T07:23:51.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85482024-08-16T07:23:51.662ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85492024-08-16T07:23:51.705ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "50602b07-2b57-4b1b-8c65-bb8295f13437", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
85502024-08-16T07:23:51.706ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 418.303881ms iteration = 16 status = {}
85512024-08-16T07:23:51.712ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
85522024-08-16T07:23:51.750ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
85532024-08-16T07:23:51.750ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85542024-08-16T07:23:51.750ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "414a1e1a-3ef8-4b8a-b92b-a88cc90a63a7", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
85552024-08-16T07:23:51.750ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85562024-08-16T07:23:51.752ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
85572024-08-16T07:23:51.752ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85582024-08-16T07:23:51.752ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c833ed8c-e49d-45d5-9c66-8e951cda6626", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
85592024-08-16T07:23:51.752ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85602024-08-16T07:23:51.752ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85612024-08-16T07:23:51.754ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85622024-08-16T07:23:51.882ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 601.296126ms iteration = 15 status = {}
85632024-08-16T07:23:51.917ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
85642024-08-16T07:23:51.917ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85652024-08-16T07:23:51.918ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9ab43ebf-c22c-4cb5-927b-af6a337db188", "content-length": "26", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
85662024-08-16T07:23:51.918ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85672024-08-16T07:23:51.920ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
85682024-08-16T07:23:52.002ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
85692024-08-16T07:23:52.013ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85702024-08-16T07:23:52.014ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "60ceab70-7a7c-4ff2-9380-233794a959b7", "content-length": "1", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
85712024-08-16T07:23:52.016ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85722024-08-16T07:23:52.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85732024-08-16T07:23:52.019ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 737.763519ms iteration = 15 status = null
85742024-08-16T07:23:52.079ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
85752024-08-16T07:23:52.079ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "67bf8d6a-866e-49e3-84ac-5aa6e23ad14f", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85762024-08-16T07:23:52.079ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85772024-08-16T07:23:52.081ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e8d2d911-7659-457c-874e-d89162eea231", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85782024-08-16T07:23:52.081ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85792024-08-16T07:23:52.083ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7fc804e2-222f-40b4-9c22-4eb10e233ac5", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85802024-08-16T07:23:52.083ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85812024-08-16T07:23:52.084ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85822024-08-16T07:23:52.084ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 803.339903ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
85832024-08-16T07:23:52.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85842024-08-16T07:23:52.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85852024-08-16T07:23:52.109ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
85862024-08-16T07:23:52.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85872024-08-16T07:23:52.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85882024-08-16T07:23:52.117ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85892024-08-16T07:23:52.119ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "76874e44-7d70-4cac-9494-4254ca1af03a", "content-length": "121", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
85902024-08-16T07:23:52.119ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
85912024-08-16T07:23:52.119ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
85922024-08-16T07:23:52.119ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
85932024-08-16T07:23:52.119ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
85942024-08-16T07:23:52.119ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
85952024-08-16T07:23:52.119ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
85962024-08-16T07:23:52.119ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
85972024-08-16T07:23:52.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85982024-08-16T07:23:52.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85992024-08-16T07:23:52.121ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
86002024-08-16T07:23:52.121ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4c151457-4531-49ab-9c1c-b160713b59cc", "content-length": "2", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
86012024-08-16T07:23:52.121ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
86022024-08-16T07:23:52.121ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8aa7594c-76cc-45c8-aaf7-c8ac0f85c4ac", "content-length": "52", "date": "Fri, 16 Aug 2024 07:23:51 GMT"} })
86032024-08-16T07:23:52.121ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
86042024-08-16T07:23:52.121ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
86052024-08-16T07:23:52.172ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d4b03166-f393-4d2a-a957-68581006ea68", "date": "Fri, 16 Aug 2024 07:23:52 GMT"} })
86062024-08-16T07:23:52.172ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
86072024-08-16T07:23:52.172ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86082024-08-16T07:23:52.173ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "49efd3ed-7804-4735-9d33-99059999a6bc", "content-length": "494", "date": "Fri, 16 Aug 2024 07:23:52 GMT"} })
86092024-08-16T07:23:52.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86102024-08-16T07:23:52.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86112024-08-16T07:23:52.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86122024-08-16T07:23:52.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86132024-08-16T07:23:52.179ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86142024-08-16T07:23:52.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86152024-08-16T07:23:52.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86162024-08-16T07:23:52.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86172024-08-16T07:23:52.187ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 906.224119ms iteration = 15 status = {}
86182024-08-16T07:23:53.120ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1574 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 7e7497ee-b7c2-42dc-824b-42cf8bdfe813 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
86192024-08-16T07:24:01.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
86202024-08-16T07:24:01.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86212024-08-16T07:24:01.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86222024-08-16T07:24:01.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86232024-08-16T07:24:01.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
86242024-08-16T07:24:01.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
86252024-08-16T07:24:01.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86262024-08-16T07:24:01.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86272024-08-16T07:24:01.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86282024-08-16T07:24:01.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86292024-08-16T07:24:01.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86302024-08-16T07:24:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86312024-08-16T07:24:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86322024-08-16T07:24:01.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86332024-08-16T07:24:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86342024-08-16T07:24:01.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
86352024-08-16T07:24:01.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.513621ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86362024-08-16T07:24:01.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86372024-08-16T07:24:01.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
86382024-08-16T07:24:01.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86392024-08-16T07:24:01.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86402024-08-16T07:24:01.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
86412024-08-16T07:24:01.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.194041ms iteration = 44 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
86422024-08-16T07:24:03.120ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1842 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 0f7493ba-a33f-485d-9e30-c8a056f2f7bb response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
86432024-08-16T07:24:11.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
86442024-08-16T07:24:11.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86452024-08-16T07:24:11.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86462024-08-16T07:24:11.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86472024-08-16T07:24:11.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
86482024-08-16T07:24:11.282ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
86492024-08-16T07:24:11.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86502024-08-16T07:24:11.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86512024-08-16T07:24:11.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86522024-08-16T07:24:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86532024-08-16T07:24:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86542024-08-16T07:24:11.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86552024-08-16T07:24:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86562024-08-16T07:24:11.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
86572024-08-16T07:24:11.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.827679ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86582024-08-16T07:24:11.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86592024-08-16T07:24:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86602024-08-16T07:24:11.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86612024-08-16T07:24:11.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
86622024-08-16T07:24:11.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86632024-08-16T07:24:11.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86642024-08-16T07:24:11.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
86652024-08-16T07:24:11.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.470577ms iteration = 45 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
86662024-08-16T07:24:13.120ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1786 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = ec0e053e-974f-43e4-bafa-4b2450d9fb9d response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
86672024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
86682024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
86692024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86702024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86712024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
86722024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
86732024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
86742024-08-16T07:24:21.281ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
86752024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
86762024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86772024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
86782024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86792024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
86802024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
86812024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86822024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86832024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
86842024-08-16T07:24:21.281ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
86852024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86862024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86872024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86882024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
86892024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86902024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86912024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86922024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86932024-08-16T07:24:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86942024-08-16T07:24:21.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
86952024-08-16T07:24:21.282ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
86962024-08-16T07:24:21.282ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
86972024-08-16T07:24:21.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86982024-08-16T07:24:21.282ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86992024-08-16T07:24:21.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87002024-08-16T07:24:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87012024-08-16T07:24:21.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87022024-08-16T07:24:21.282ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87032024-08-16T07:24:21.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87042024-08-16T07:24:21.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87052024-08-16T07:24:21.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87062024-08-16T07:24:21.284ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
87072024-08-16T07:24:21.284ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.411029ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87082024-08-16T07:24:21.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87092024-08-16T07:24:21.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87102024-08-16T07:24:21.284ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1524, tv_nsec: 662450225 } })
87112024-08-16T07:24:21.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
87122024-08-16T07:24:21.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.578653ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87132024-08-16T07:24:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87142024-08-16T07:24:21.286ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87152024-08-16T07:24:21.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1524, tv_nsec: 663795946 } })
87162024-08-16T07:24:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87172024-08-16T07:24:21.286ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
87182024-08-16T07:24:21.287ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
87192024-08-16T07:24:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87202024-08-16T07:24:21.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87212024-08-16T07:24:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87222024-08-16T07:24:21.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87232024-08-16T07:24:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87242024-08-16T07:24:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87252024-08-16T07:24:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
87262024-08-16T07:24:21.287ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87272024-08-16T07:24:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87282024-08-16T07:24:21.287ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
87292024-08-16T07:24:21.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87302024-08-16T07:24:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87312024-08-16T07:24:21.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87322024-08-16T07:24:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87332024-08-16T07:24:21.288ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
87342024-08-16T07:24:21.288ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
87352024-08-16T07:24:21.288ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87362024-08-16T07:24:21.288ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87372024-08-16T07:24:21.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87382024-08-16T07:24:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87392024-08-16T07:24:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87402024-08-16T07:24:21.289ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
87412024-08-16T07:24:21.289ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
87422024-08-16T07:24:21.289ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
87432024-08-16T07:24:21.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87442024-08-16T07:24:21.289ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
87452024-08-16T07:24:21.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87462024-08-16T07:24:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
87472024-08-16T07:24:21.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87482024-08-16T07:24:21.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87492024-08-16T07:24:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
87502024-08-16T07:24:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87512024-08-16T07:24:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87522024-08-16T07:24:21.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87532024-08-16T07:24:21.289ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1524, tv_nsec: 667044802 } })
87542024-08-16T07:24:21.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87552024-08-16T07:24:21.290ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
87562024-08-16T07:24:21.290ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
87572024-08-16T07:24:21.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.589997ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
87582024-08-16T07:24:21.290ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
87592024-08-16T07:24:21.290ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
87602024-08-16T07:24:21.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87612024-08-16T07:24:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87622024-08-16T07:24:21.291ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87632024-08-16T07:24:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87642024-08-16T07:24:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87652024-08-16T07:24:21.292ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87662024-08-16T07:24:21.292ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87672024-08-16T07:24:21.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87682024-08-16T07:24:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87692024-08-16T07:24:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87702024-08-16T07:24:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
87712024-08-16T07:24:21.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87722024-08-16T07:24:21.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87732024-08-16T07:24:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87742024-08-16T07:24:21.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87752024-08-16T07:24:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87762024-08-16T07:24:21.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87772024-08-16T07:24:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87782024-08-16T07:24:21.295ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
87792024-08-16T07:24:21.295ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 12.508099ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
87802024-08-16T07:24:21.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87812024-08-16T07:24:21.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87822024-08-16T07:24:21.295ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
87832024-08-16T07:24:21.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.159533ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
87842024-08-16T07:24:21.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87852024-08-16T07:24:21.303ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
87862024-08-16T07:24:21.303ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 22.421948ms iteration = 18 status = {"physical_disks_added":0}
87872024-08-16T07:24:21.305ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
87882024-08-16T07:24:21.305ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.584208ms iteration = 46 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
87892024-08-16T07:24:21.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87902024-08-16T07:24:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87912024-08-16T07:24:21.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87922024-08-16T07:24:21.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87932024-08-16T07:24:21.312ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87942024-08-16T07:24:21.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87952024-08-16T07:24:21.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87962024-08-16T07:24:21.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87972024-08-16T07:24:21.314ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87982024-08-16T07:24:21.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87992024-08-16T07:24:21.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88002024-08-16T07:24:21.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88012024-08-16T07:24:21.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88022024-08-16T07:24:21.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88032024-08-16T07:24:21.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88042024-08-16T07:24:21.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
88052024-08-16T07:24:21.320ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88062024-08-16T07:24:21.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88072024-08-16T07:24:21.322ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 41.194932ms iteration = 16 status = 0
88082024-08-16T07:24:21.323ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88092024-08-16T07:24:21.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88102024-08-16T07:24:21.325ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
88112024-08-16T07:24:21.325ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 43.871213ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
88122024-08-16T07:24:21.331ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
88132024-08-16T07:24:21.331ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88142024-08-16T07:24:21.331ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 42.469681ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
88152024-08-16T07:24:21.420ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
88162024-08-16T07:24:21.420ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88172024-08-16T07:24:21.420ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "17a6d859-4581-456c-b7e0-068d07b45160", "content-length": "26", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
88182024-08-16T07:24:21.420ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88192024-08-16T07:24:21.421ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88202024-08-16T07:24:21.454ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88212024-08-16T07:24:21.454ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d20d2eb8-fc7d-4353-a199-e0f857f355b8", "content-length": "372", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
88222024-08-16T07:24:21.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88232024-08-16T07:24:21.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88242024-08-16T07:24:21.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88252024-08-16T07:24:21.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88262024-08-16T07:24:21.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88272024-08-16T07:24:21.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88282024-08-16T07:24:21.461ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88292024-08-16T07:24:21.462ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f61e4c07-e961-4510-9cac-e6200d0a41d0", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
88302024-08-16T07:24:21.463ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 174.824178ms iteration = 17 status = {}
88312024-08-16T07:24:21.554ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
88322024-08-16T07:24:21.554ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7bc7ed62-f19c-40d9-bf07-bb2479526ace", "content-length": "2", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
88332024-08-16T07:24:21.556ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88342024-08-16T07:24:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88352024-08-16T07:24:21.558ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 277.017157ms iteration = 16 status = null
88362024-08-16T07:24:21.621ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
88372024-08-16T07:24:21.621ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88382024-08-16T07:24:21.621ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0408852b-a494-49b4-bbf7-725fa93d6e55", "content-length": "26", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
88392024-08-16T07:24:21.621ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88402024-08-16T07:24:21.623ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88412024-08-16T07:24:21.623ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
88422024-08-16T07:24:21.623ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88432024-08-16T07:24:21.624ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "da34e02e-01d8-4a91-9bb7-9dff1d41a431", "content-length": "26", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
88442024-08-16T07:24:21.624ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88452024-08-16T07:24:21.626ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
88462024-08-16T07:24:21.647ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
88472024-08-16T07:24:21.648ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f7d00ae7-71cc-4157-9e71-ca8ecdc56ccd", "content-length": "691", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
88482024-08-16T07:24:21.648ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
88492024-08-16T07:24:21.648ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
88502024-08-16T07:24:21.648ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
88512024-08-16T07:24:21.649ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 368.732576ms iteration = 16 status = {}
88522024-08-16T07:24:21.680ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 399.708641ms iteration = 16 status = {}
88532024-08-16T07:24:21.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88542024-08-16T07:24:21.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88552024-08-16T07:24:21.737ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
88562024-08-16T07:24:21.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88572024-08-16T07:24:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88582024-08-16T07:24:21.743ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
88592024-08-16T07:24:21.744ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "84c9e29b-98c8-4350-b805-83704ad118af", "content-length": "121", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
88602024-08-16T07:24:21.744ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
88612024-08-16T07:24:21.744ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
88622024-08-16T07:24:21.744ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
88632024-08-16T07:24:21.744ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
88642024-08-16T07:24:21.744ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
88652024-08-16T07:24:21.744ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
88662024-08-16T07:24:21.744ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
88672024-08-16T07:24:21.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88682024-08-16T07:24:21.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88692024-08-16T07:24:21.746ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
88702024-08-16T07:24:21.746ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a1a70656-bc41-403e-b982-804e9add49cc", "content-length": "2", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
88712024-08-16T07:24:21.746ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
88722024-08-16T07:24:21.746ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1c2d837f-5606-4aba-ac43-0f893666064d", "content-length": "52", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
88732024-08-16T07:24:21.746ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
88742024-08-16T07:24:21.746ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
88752024-08-16T07:24:21.797ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c859cc51-c142-4fa9-88bb-14fd8e4d8e51", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
88762024-08-16T07:24:21.797ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
88772024-08-16T07:24:21.797ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
88782024-08-16T07:24:21.797ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1386e446-b221-465d-84f8-e56aa6a12b7f", "content-length": "494", "date": "Fri, 16 Aug 2024 07:24:21 GMT"} })
88792024-08-16T07:24:21.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88802024-08-16T07:24:21.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88812024-08-16T07:24:21.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88822024-08-16T07:24:21.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88832024-08-16T07:24:21.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88842024-08-16T07:24:21.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88852024-08-16T07:24:21.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88862024-08-16T07:24:21.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88872024-08-16T07:24:21.810ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 528.969737ms iteration = 16 status = {}
88882024-08-16T07:24:23.120ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1322 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 1ab71872-b2cc-463c-9300-418b20ec35c6 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
88892024-08-16T07:24:31.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
88902024-08-16T07:24:31.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88912024-08-16T07:24:31.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88922024-08-16T07:24:31.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88932024-08-16T07:24:31.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
88942024-08-16T07:24:31.282ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
88952024-08-16T07:24:31.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88962024-08-16T07:24:31.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88972024-08-16T07:24:31.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88982024-08-16T07:24:31.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88992024-08-16T07:24:31.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89002024-08-16T07:24:31.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89012024-08-16T07:24:31.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89022024-08-16T07:24:31.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89032024-08-16T07:24:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89042024-08-16T07:24:31.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
89052024-08-16T07:24:31.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.183294ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89062024-08-16T07:24:31.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89072024-08-16T07:24:31.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
89082024-08-16T07:24:31.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89092024-08-16T07:24:31.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89102024-08-16T07:24:31.294ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
89112024-08-16T07:24:31.294ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.423473ms iteration = 47 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
89122024-08-16T07:24:33.119ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1485 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 152421fc-40f3-41a3-b7ee-785b4932da21 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
89132024-08-16T07:24:33.121ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
89142024-08-16T07:24:33.121ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
89152024-08-16T07:24:33.152ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
89162024-08-16T07:24:33.152ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:46125
89172024-08-16T07:24:33.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46125 req_id = 8b755c19-0a68-4046-8835-95e5a27717b4 roles = RoleSet { roles: {} } uri = /metrics/producers
89182024-08-16T07:24:33.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46125 req_id = 8b755c19-0a68-4046-8835-95e5a27717b4 resource = Database result = Ok(()) uri = /metrics/producers
89192024-08-16T07:24:33.184ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
89202024-08-16T07:24:33.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46125 req_id = 8b755c19-0a68-4046-8835-95e5a27717b4 roles = RoleSet { roles: {} } uri = /metrics/producers
89212024-08-16T07:24:33.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46125 req_id = 8b755c19-0a68-4046-8835-95e5a27717b4 resource = Database result = Ok(()) uri = /metrics/producers
89222024-08-16T07:24:33.192ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
89232024-08-16T07:24:33.192ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "038b698a-27ef-48cb-be5c-8fad74eb5f54", "date": "Fri, 16 Aug 2024 07:24:33 GMT"} })
89242024-08-16T07:24:33.192ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 09eed6fc-f2ea-4ebd-a66c-d8895818c00c
89252024-08-16T07:24:33.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 41988 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46125 req_id = 8b755c19-0a68-4046-8835-95e5a27717b4 response_code = 201 uri = /metrics/producers
89262024-08-16T07:24:33.194ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "8b755c19-0a68-4046-8835-95e5a27717b4", "content-length": "41", "date": "Fri, 16 Aug 2024 07:24:33 GMT"} })
89272024-08-16T07:24:33.195ZDEBGnexus (producer-registration-task): registered with nexus successfully
89282024-08-16T07:24:33.195ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
89292024-08-16T07:24:41.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
89302024-08-16T07:24:41.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89312024-08-16T07:24:41.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89322024-08-16T07:24:41.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
89332024-08-16T07:24:41.282ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
89342024-08-16T07:24:41.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89352024-08-16T07:24:41.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89362024-08-16T07:24:41.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89372024-08-16T07:24:41.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89382024-08-16T07:24:41.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89392024-08-16T07:24:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89402024-08-16T07:24:41.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89412024-08-16T07:24:41.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89422024-08-16T07:24:41.285ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
89432024-08-16T07:24:41.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.02684ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89442024-08-16T07:24:41.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89452024-08-16T07:24:41.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89462024-08-16T07:24:41.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89472024-08-16T07:24:41.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
89482024-08-16T07:24:41.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89492024-08-16T07:24:41.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89502024-08-16T07:24:41.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
89512024-08-16T07:24:41.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.28157ms iteration = 48 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
89522024-08-16T07:24:43.195ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1816 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 8846153c-8cd0-474d-bca6-86c43bfa8daa response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
89532024-08-16T07:24:44.763ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:59338
89542024-08-16T07:24:44.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59338 req_id = 252b04bc-52da-4e7f-b0ab-9148d8928909 roles = RoleSet { roles: {} } uri = /metrics/producers
89552024-08-16T07:24:44.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59338 req_id = 252b04bc-52da-4e7f-b0ab-9148d8928909 resource = Database result = Ok(()) uri = /metrics/producers
89562024-08-16T07:24:44.796ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
89572024-08-16T07:24:44.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59338 req_id = 252b04bc-52da-4e7f-b0ab-9148d8928909 roles = RoleSet { roles: {} } uri = /metrics/producers
89582024-08-16T07:24:44.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59338 req_id = 252b04bc-52da-4e7f-b0ab-9148d8928909 resource = Database result = Ok(()) uri = /metrics/producers
89592024-08-16T07:24:44.801ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
89602024-08-16T07:24:44.801ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c26afae9-0a18-4da4-a659-c78f0cbcb823", "date": "Fri, 16 Aug 2024 07:24:44 GMT"} })
89612024-08-16T07:24:44.801ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae
89622024-08-16T07:24:44.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 40421 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59338 req_id = 252b04bc-52da-4e7f-b0ab-9148d8928909 response_code = 201 uri = /metrics/producers
89632024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
89642024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
89652024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89662024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
89672024-08-16T07:24:51.280ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d
89682024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.991\u{b5}s iteration = 10 status = {"error":"blueprint disabled","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d"}
89692024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
89702024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
89712024-08-16T07:24:51.280ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-16 07:14:51.280799100 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
89722024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
89732024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
89742024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89752024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89762024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
89772024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
89782024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89792024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
89802024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
89812024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
89822024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89832024-08-16T07:24:51.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89842024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
89852024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
89862024-08-16T07:24:51.281ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
89872024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89882024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
89892024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89902024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
89912024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
89922024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
89932024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
89942024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89952024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
89962024-08-16T07:24:51.281ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
89972024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
89982024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89992024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
90002024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
90012024-08-16T07:24:51.281ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
90022024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90032024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90042024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90052024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90062024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
90072024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90082024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90092024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90102024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
90112024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90122024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90132024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90142024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90152024-08-16T07:24:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90162024-08-16T07:24:51.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
90172024-08-16T07:24:51.282ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
90182024-08-16T07:24:51.282ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
90192024-08-16T07:24:51.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90202024-08-16T07:24:51.282ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90212024-08-16T07:24:51.282ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d6264ea-5d56-4938-8c26-581ed0b9907b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a8440aa3-608b-4c08-b70c-6d92a9461396.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("aea2243f-052e-4953-bdfa-7c3368895dd2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 660094011 } })
90222024-08-16T07:24:51.282ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("dec19c15-1a2d-47ac-9b9e-9f424d3a3464.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f9649eef-936b-4765-9810-da8662275db5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 660100811 } })
90232024-08-16T07:24:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90242024-08-16T07:24:51.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90252024-08-16T07:24:51.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90262024-08-16T07:24:51.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90272024-08-16T07:24:51.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90282024-08-16T07:24:51.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90292024-08-16T07:24:51.284ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90302024-08-16T07:24:51.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90312024-08-16T07:24:51.284ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
90322024-08-16T07:24:51.284ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.533151ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
90332024-08-16T07:24:51.284ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-16 07:14:51.280799100 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
90342024-08-16T07:24:51.284ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.069454ms iteration = 9 status = {"expiration":"2024-08-16T07:14:51.280799100Z","pruned":[]}
90352024-08-16T07:24:51.284ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
90362024-08-16T07:24:51.285ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.274608ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
90372024-08-16T07:24:51.285ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90382024-08-16T07:24:51.285ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90392024-08-16T07:24:51.285ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90402024-08-16T07:24:51.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90412024-08-16T07:24:51.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90422024-08-16T07:24:51.286ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90432024-08-16T07:24:51.286ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
90442024-08-16T07:24:51.286ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.672401ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
90452024-08-16T07:24:51.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 664107683 } })
90462024-08-16T07:24:51.286ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 664145615 } })
90472024-08-16T07:24:51.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90482024-08-16T07:24:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
90492024-08-16T07:24:51.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90502024-08-16T07:24:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90512024-08-16T07:24:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90522024-08-16T07:24:51.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90532024-08-16T07:24:51.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90542024-08-16T07:24:51.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
90552024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90562024-08-16T07:24:51.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
90572024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
90582024-08-16T07:24:51.288ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
90592024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
90602024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
90612024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
90622024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90632024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
90642024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90652024-08-16T07:24:51.288ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
90662024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.916557ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90672024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90682024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
90692024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90702024-08-16T07:24:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90712024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
90722024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
90732024-08-16T07:24:51.289ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
90742024-08-16T07:24:51.289ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
90752024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
90762024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90772024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90782024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
90792024-08-16T07:24:51.289ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
90802024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
90812024-08-16T07:24:51.289ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 666928229 } })
90822024-08-16T07:24:51.289ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
90832024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90842024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
90852024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90862024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
90872024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90882024-08-16T07:24:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90892024-08-16T07:24:51.289ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
90902024-08-16T07:24:51.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90912024-08-16T07:24:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
90922024-08-16T07:24:51.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90932024-08-16T07:24:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
90942024-08-16T07:24:51.290ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90952024-08-16T07:24:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90962024-08-16T07:24:51.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90972024-08-16T07:24:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90982024-08-16T07:24:51.291ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
90992024-08-16T07:24:51.291ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
91002024-08-16T07:24:51.291ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91012024-08-16T07:24:51.291ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
91022024-08-16T07:24:51.291ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.16134ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
91032024-08-16T07:24:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91042024-08-16T07:24:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91052024-08-16T07:24:51.291ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
91062024-08-16T07:24:51.291ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
91072024-08-16T07:24:51.291ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
91082024-08-16T07:24:51.291ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91092024-08-16T07:24:51.292ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
91102024-08-16T07:24:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 11.177108ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
91112024-08-16T07:24:51.292ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:150
91122024-08-16T07:24:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.894767ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
91132024-08-16T07:24:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91142024-08-16T07:24:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91152024-08-16T07:24:51.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91162024-08-16T07:24:51.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91172024-08-16T07:24:51.292ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
91182024-08-16T07:24:51.292ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
91192024-08-16T07:24:51.292ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.595297ms iteration = 9 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
91202024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91212024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91222024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91232024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91242024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91252024-08-16T07:24:51.293ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
91262024-08-16T07:24:51.293ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
91272024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 5.012365ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
91282024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91292024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91302024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
91312024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
91322024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
91332024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91342024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91352024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91362024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
91372024-08-16T07:24:51.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91382024-08-16T07:24:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
91392024-08-16T07:24:51.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91402024-08-16T07:24:51.294ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
91412024-08-16T07:24:51.294ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
91422024-08-16T07:24:51.294ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 13.335108ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
91432024-08-16T07:24:51.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91442024-08-16T07:24:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
91452024-08-16T07:24:51.294ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91462024-08-16T07:24:51.294ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91472024-08-16T07:24:51.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91482024-08-16T07:24:51.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91492024-08-16T07:24:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91502024-08-16T07:24:51.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91512024-08-16T07:24:51.295ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
91522024-08-16T07:24:51.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.05062ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
91532024-08-16T07:24:51.295ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91542024-08-16T07:24:51.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91552024-08-16T07:24:51.296ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91562024-08-16T07:24:51.296ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91572024-08-16T07:24:51.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91582024-08-16T07:24:51.296ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
91592024-08-16T07:24:51.296ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 14.225118ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
91602024-08-16T07:24:51.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91612024-08-16T07:24:51.296ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91622024-08-16T07:24:51.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91632024-08-16T07:24:51.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91642024-08-16T07:24:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91652024-08-16T07:24:51.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91662024-08-16T07:24:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91672024-08-16T07:24:51.298ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91682024-08-16T07:24:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91692024-08-16T07:24:51.298ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
91702024-08-16T07:24:51.298ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
91712024-08-16T07:24:51.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91722024-08-16T07:24:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91732024-08-16T07:24:51.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
91742024-08-16T07:24:51.298ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91752024-08-16T07:24:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91762024-08-16T07:24:51.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91772024-08-16T07:24:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91782024-08-16T07:24:51.299ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91792024-08-16T07:24:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
91802024-08-16T07:24:51.299ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91812024-08-16T07:24:51.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91822024-08-16T07:24:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91832024-08-16T07:24:51.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91842024-08-16T07:24:51.301ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
91852024-08-16T07:24:51.301ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 0 version = 2
91862024-08-16T07:24:51.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91872024-08-16T07:24:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91882024-08-16T07:24:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91892024-08-16T07:24:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91902024-08-16T07:24:51.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91912024-08-16T07:24:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91922024-08-16T07:24:51.302ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91932024-08-16T07:24:51.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91942024-08-16T07:24:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91952024-08-16T07:24:51.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91962024-08-16T07:24:51.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91972024-08-16T07:24:51.304ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2c55b660-f328-498e-b44c-73da75015ed4 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
91982024-08-16T07:24:51.304ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
91992024-08-16T07:24:51.304ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-16 07:16:55.302318 UTC dns_group = internal generation = 1
92002024-08-16T07:24:51.304ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 23.424271ms iteration = 10 status = {"generation":1}
92012024-08-16T07:24:51.304ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
92022024-08-16T07:24:51.304ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92032024-08-16T07:24:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92042024-08-16T07:24:51.304ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
92052024-08-16T07:24:51.304ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.940053ms iteration = 49 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
92062024-08-16T07:24:51.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92072024-08-16T07:24:51.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92082024-08-16T07:24:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92092024-08-16T07:24:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
92102024-08-16T07:24:51.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92112024-08-16T07:24:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92122024-08-16T07:24:51.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92132024-08-16T07:24:51.307ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = ddebb22e-3faa-4936-9b3e-0f4d28827c0e dns_zone_name = oxide.test found_so_far = 1 version = 2
92142024-08-16T07:24:51.307ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
92152024-08-16T07:24:51.307ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-16 07:16:55.724690 UTC dns_group = external generation = 2
92162024-08-16T07:24:51.307ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 27.021304ms iteration = 10 status = {"generation":2}
92172024-08-16T07:24:51.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92182024-08-16T07:24:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92192024-08-16T07:24:51.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92202024-08-16T07:24:51.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92212024-08-16T07:24:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92222024-08-16T07:24:51.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92232024-08-16T07:24:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92242024-08-16T07:24:51.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92252024-08-16T07:24:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
92262024-08-16T07:24:51.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92272024-08-16T07:24:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92282024-08-16T07:24:51.313ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 32.90043ms iteration = 17 status = 0
92292024-08-16T07:24:51.323ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-16T07:16:49.943339Z, time_modified: 2024-08-16T07:16:49.943339Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, db_silo: Silo { identity: SiloIdentity { id: 439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-16T07:16:55.682566Z, time_modified: 2024-08-16T07:16:55.682566Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f" }] }) }
92302024-08-16T07:24:51.323ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 42.973392ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]}},"default_endpoint":{"silo_id":"439ae9f4-a6c9-4e1a-9a55-b2dbd3fe7071","tls_certs":["c9e400628d2b58a74b998fbfa44a053952e83a6e8d3c49e6518981bf7d4a006f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
92312024-08-16T07:24:51.329ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
92322024-08-16T07:24:51.329ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 48.978281ms iteration = 19 status = {"physical_disks_added":0}
92332024-08-16T07:24:51.453ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
92342024-08-16T07:24:51.459ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
92352024-08-16T07:24:51.459ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
92362024-08-16T07:24:51.459ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92372024-08-16T07:24:51.459ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b926379c-8ee6-4f03-818c-4cd494c35f35", "content-length": "26", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
92382024-08-16T07:24:51.459ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92392024-08-16T07:24:51.460ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
92402024-08-16T07:24:51.537ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92412024-08-16T07:24:51.543ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f753f2d3-c2ff-4a94-a688-afb9c930f103", "content-length": "372", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
92422024-08-16T07:24:51.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92432024-08-16T07:24:51.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92442024-08-16T07:24:51.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92452024-08-16T07:24:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92462024-08-16T07:24:51.547ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
92472024-08-16T07:24:51.547ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3bec2ba2-0748-46c5-ba64-cee6ec7367b9", "content-length": "691", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
92482024-08-16T07:24:51.547ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
92492024-08-16T07:24:51.547ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
92502024-08-16T07:24:51.547ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
92512024-08-16T07:24:51.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92522024-08-16T07:24:51.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92532024-08-16T07:24:51.549ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 268.330096ms iteration = 17 status = {}
92542024-08-16T07:24:51.550ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92552024-08-16T07:24:51.551ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "26745c5f-e812-4ac8-b8c0-a794beae3691", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
92562024-08-16T07:24:51.552ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 264.280173ms iteration = 18 status = {}
92572024-08-16T07:24:51.617ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
92582024-08-16T07:24:51.617ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92592024-08-16T07:24:51.617ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6d312680-2929-454b-adc9-027b54127681", "content-length": "26", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
92602024-08-16T07:24:51.617ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92612024-08-16T07:24:51.619ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92622024-08-16T07:24:51.627ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
92632024-08-16T07:24:51.628ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e7c4e3bb-10a1-42b5-a4b3-4ca07819b4ba", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92642024-08-16T07:24:51.628ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92652024-08-16T07:24:51.628ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
92662024-08-16T07:24:51.629ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
92672024-08-16T07:24:51.629ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92682024-08-16T07:24:51.630ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "36439549-4e45-425e-807c-b12cfb9291a1", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92692024-08-16T07:24:51.630ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92702024-08-16T07:24:51.630ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2f1caae1-408a-436f-8031-b5535061d5e0", "content-length": "26", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
92712024-08-16T07:24:51.630ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92722024-08-16T07:24:51.632ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92732024-08-16T07:24:51.632ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 351.996769ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
92742024-08-16T07:24:51.633ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92752024-08-16T07:24:51.732ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 451.821264ms iteration = 17 status = {}
92762024-08-16T07:24:51.734ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
92772024-08-16T07:24:51.735ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0ebf9c14-c698-4ee4-adf5-c04a9191271b", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
92782024-08-16T07:24:51.735ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
92792024-08-16T07:24:51.736ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5f08d6ae-55c0-43a2-ab48-f3270bc00cc9", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
92802024-08-16T07:24:51.736ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
92812024-08-16T07:24:51.738ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1e4d982f-92ce-42d6-8c01-fdeaf83e39fa", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
92822024-08-16T07:24:51.738ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
92832024-08-16T07:24:51.740ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
92842024-08-16T07:24:51.740ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1abc4dad-5400-48f5-aea3-1f152f9b0332", "content-length": "2", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
92852024-08-16T07:24:51.740ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
92862024-08-16T07:24:51.740ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 459.88287ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
92872024-08-16T07:24:51.742ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92882024-08-16T07:24:51.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92892024-08-16T07:24:51.743ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 462.528022ms iteration = 17 status = null
92902024-08-16T07:24:51.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92912024-08-16T07:24:51.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92922024-08-16T07:24:51.764ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
92932024-08-16T07:24:51.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92942024-08-16T07:24:51.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92952024-08-16T07:24:51.770ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
92962024-08-16T07:24:51.771ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6cf095b5-f593-444f-bbc7-0f8744266a45", "content-length": "121", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
92972024-08-16T07:24:51.771ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
92982024-08-16T07:24:51.771ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
92992024-08-16T07:24:51.771ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
93002024-08-16T07:24:51.771ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
93012024-08-16T07:24:51.771ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
93022024-08-16T07:24:51.771ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
93032024-08-16T07:24:51.771ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
93042024-08-16T07:24:51.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93052024-08-16T07:24:51.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93062024-08-16T07:24:51.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93072024-08-16T07:24:51.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2ee85ad6-e8f7-4c20-aa03-3787c9f4384c", "content-length": "2", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
93082024-08-16T07:24:51.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93092024-08-16T07:24:51.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f22d07cf-019e-4f5c-bb58-7e98763d2226", "content-length": "52", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
93102024-08-16T07:24:51.773ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
93112024-08-16T07:24:51.773ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93122024-08-16T07:24:51.822ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "de32eadf-5181-438d-b545-de518f12720f", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
93132024-08-16T07:24:51.822ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
93142024-08-16T07:24:51.822ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93152024-08-16T07:24:51.822ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c7ee50ab-e7c1-4e97-8605-f40b59d451e8", "content-length": "494", "date": "Fri, 16 Aug 2024 07:24:51 GMT"} })
93162024-08-16T07:24:51.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93172024-08-16T07:24:51.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93182024-08-16T07:24:51.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93192024-08-16T07:24:51.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93202024-08-16T07:24:51.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93212024-08-16T07:24:51.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93222024-08-16T07:24:51.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93232024-08-16T07:24:51.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93242024-08-16T07:24:51.837ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 556.989963ms iteration = 17 status = {}
93252024-08-16T07:24:53.196ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 7240e9c3-b513-4891-bdbc-48ef1755ff88 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
93262024-08-16T07:24:53.826ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:62133
93272024-08-16T07:24:53.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62133 req_id = 69607bf2-d3f8-49b2-9232-82010a9feb14 roles = RoleSet { roles: {} } uri = /metrics/producers
93282024-08-16T07:24:53.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62133 req_id = 69607bf2-d3f8-49b2-9232-82010a9feb14 resource = Database result = Ok(()) uri = /metrics/producers
93292024-08-16T07:24:53.859ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
93302024-08-16T07:24:53.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62133 req_id = 69607bf2-d3f8-49b2-9232-82010a9feb14 roles = RoleSet { roles: {} } uri = /metrics/producers
93312024-08-16T07:24:53.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62133 req_id = 69607bf2-d3f8-49b2-9232-82010a9feb14 resource = Database result = Ok(()) uri = /metrics/producers
93322024-08-16T07:24:53.866ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
93332024-08-16T07:24:53.867ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "514e6173-8a3c-47eb-b031-1c2debea33cc", "date": "Fri, 16 Aug 2024 07:24:53 GMT"} })
93342024-08-16T07:24:53.867ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 48a86640-720d-4ca7-a9c7-97a8f5a86939
93352024-08-16T07:24:53.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 41210 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62133 req_id = 69607bf2-d3f8-49b2-9232-82010a9feb14 response_code = 201 uri = /metrics/producers
93362024-08-16T07:25:01.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
93372024-08-16T07:25:01.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93382024-08-16T07:25:01.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93392024-08-16T07:25:01.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93402024-08-16T07:25:01.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
93412024-08-16T07:25:01.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
93422024-08-16T07:25:01.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93432024-08-16T07:25:01.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93442024-08-16T07:25:01.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93452024-08-16T07:25:01.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93462024-08-16T07:25:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93472024-08-16T07:25:01.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93482024-08-16T07:25:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93492024-08-16T07:25:01.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93502024-08-16T07:25:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93512024-08-16T07:25:01.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
93522024-08-16T07:25:01.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.986829ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93532024-08-16T07:25:01.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93542024-08-16T07:25:01.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
93552024-08-16T07:25:01.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93562024-08-16T07:25:01.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93572024-08-16T07:25:01.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
93582024-08-16T07:25:01.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.011607ms iteration = 50 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
93592024-08-16T07:25:02.494ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:47399
93602024-08-16T07:25:02.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47399 req_id = f9808cdb-40a3-4b86-87bf-952e4c28eba9 roles = RoleSet { roles: {} } uri = /metrics/producers
93612024-08-16T07:25:02.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47399 req_id = f9808cdb-40a3-4b86-87bf-952e4c28eba9 resource = Database result = Ok(()) uri = /metrics/producers
93622024-08-16T07:25:02.526ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
93632024-08-16T07:25:02.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47399 req_id = f9808cdb-40a3-4b86-87bf-952e4c28eba9 roles = RoleSet { roles: {} } uri = /metrics/producers
93642024-08-16T07:25:02.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47399 req_id = f9808cdb-40a3-4b86-87bf-952e4c28eba9 resource = Database result = Ok(()) uri = /metrics/producers
93652024-08-16T07:25:02.536ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
93662024-08-16T07:25:02.537ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8591e3e0-6af3-464c-8117-f7e2c05db3b2", "date": "Fri, 16 Aug 2024 07:25:02 GMT"} })
93672024-08-16T07:25:02.537ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 89fb4a58-54f1-4b77-bc54-dd764b735a68
93682024-08-16T07:25:02.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 43848 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47399 req_id = f9808cdb-40a3-4b86-87bf-952e4c28eba9 response_code = 201 uri = /metrics/producers
93692024-08-16T07:25:03.195ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1356 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 4f403907-fb44-4564-a8c2-631120d08057 response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
93702024-08-16T07:25:11.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
93712024-08-16T07:25:11.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93722024-08-16T07:25:11.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93732024-08-16T07:25:11.282ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
93742024-08-16T07:25:11.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93752024-08-16T07:25:11.282ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
93762024-08-16T07:25:11.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93772024-08-16T07:25:11.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93782024-08-16T07:25:11.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93792024-08-16T07:25:11.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93802024-08-16T07:25:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93812024-08-16T07:25:11.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93822024-08-16T07:25:11.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93832024-08-16T07:25:11.285ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
93842024-08-16T07:25:11.285ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.068071ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93852024-08-16T07:25:11.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93862024-08-16T07:25:11.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93872024-08-16T07:25:11.287ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93882024-08-16T07:25:11.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
93892024-08-16T07:25:11.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93902024-08-16T07:25:11.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93912024-08-16T07:25:11.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
93922024-08-16T07:25:11.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.910575ms iteration = 51 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
93932024-08-16T07:25:13.195ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1474 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = 0346c224-d1a5-4145-9a80-df7066c37e2f response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
93942024-08-16T07:25:17.166ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:48930
93952024-08-16T07:25:17.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48930 req_id = d3d7a3a3-7790-421b-84be-b2e9c4ae31d7 roles = RoleSet { roles: {} } uri = /metrics/producers
93962024-08-16T07:25:17.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48930 req_id = d3d7a3a3-7790-421b-84be-b2e9c4ae31d7 resource = Database result = Ok(()) uri = /metrics/producers
93972024-08-16T07:25:17.200ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
93982024-08-16T07:25:17.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48930 req_id = d3d7a3a3-7790-421b-84be-b2e9c4ae31d7 roles = RoleSet { roles: {} } uri = /metrics/producers
93992024-08-16T07:25:17.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48930 req_id = d3d7a3a3-7790-421b-84be-b2e9c4ae31d7 resource = Database result = Ok(()) uri = /metrics/producers
94002024-08-16T07:25:17.206ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
94012024-08-16T07:25:17.207ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "745bef6e-6397-434c-b029-cf727132e993", "date": "Fri, 16 Aug 2024 07:25:17 GMT"} })
94022024-08-16T07:25:17.207ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = 911a2faf-c618-4671-9845-24941ebe21a2
94032024-08-16T07:25:17.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 42242 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48930 req_id = d3d7a3a3-7790-421b-84be-b2e9c4ae31d7 response_code = 201 uri = /metrics/producers
94042024-08-16T07:25:21.280ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
94052024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
94062024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94072024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
94082024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94092024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
94102024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
94112024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94122024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
94132024-08-16T07:25:21.281ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
94142024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
94152024-08-16T07:25:21.281ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
94162024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
94172024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94182024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
94192024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94202024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94212024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
94222024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94232024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94242024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94252024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
94262024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94272024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94282024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94292024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94302024-08-16T07:25:21.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94312024-08-16T07:25:21.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94322024-08-16T07:25:21.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94332024-08-16T07:25:21.283ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94342024-08-16T07:25:21.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
94352024-08-16T07:25:21.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
94362024-08-16T07:25:21.283ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
94372024-08-16T07:25:21.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94382024-08-16T07:25:21.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94392024-08-16T07:25:21.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94402024-08-16T07:25:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94412024-08-16T07:25:21.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94422024-08-16T07:25:21.283ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
94432024-08-16T07:25:21.283ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.923117ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
94442024-08-16T07:25:21.284ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1584, tv_nsec: 661822713 } })
94452024-08-16T07:25:21.284ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94462024-08-16T07:25:21.284ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1584, tv_nsec: 661985976 } })
94472024-08-16T07:25:21.285ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
94482024-08-16T07:25:21.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94492024-08-16T07:25:21.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94502024-08-16T07:25:21.286ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
94512024-08-16T07:25:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94522024-08-16T07:25:21.286ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94532024-08-16T07:25:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94542024-08-16T07:25:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
94552024-08-16T07:25:21.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94562024-08-16T07:25:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
94572024-08-16T07:25:21.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94582024-08-16T07:25:21.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
94592024-08-16T07:25:21.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.47638ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94602024-08-16T07:25:21.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94612024-08-16T07:25:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94622024-08-16T07:25:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
94632024-08-16T07:25:21.287ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94642024-08-16T07:25:21.287ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94652024-08-16T07:25:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94662024-08-16T07:25:21.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94672024-08-16T07:25:21.287ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
94682024-08-16T07:25:21.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94692024-08-16T07:25:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94702024-08-16T07:25:21.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94712024-08-16T07:25:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94722024-08-16T07:25:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94732024-08-16T07:25:21.288ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
94742024-08-16T07:25:21.288ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
94752024-08-16T07:25:21.288ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
94762024-08-16T07:25:21.288ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94772024-08-16T07:25:21.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94782024-08-16T07:25:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94792024-08-16T07:25:21.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94802024-08-16T07:25:21.288ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1584, tv_nsec: 665973559 } })
94812024-08-16T07:25:21.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94822024-08-16T07:25:21.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94832024-08-16T07:25:21.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94842024-08-16T07:25:21.289ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
94852024-08-16T07:25:21.289ZINFOnexus (BackgroundTasks): region snapshot replacement start task started background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:236
94862024-08-16T07:25:21.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
94872024-08-16T07:25:21.289ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
94882024-08-16T07:25:21.289ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task started background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:133
94892024-08-16T07:25:21.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
94902024-08-16T07:25:21.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94912024-08-16T07:25:21.289ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
94922024-08-16T07:25:21.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94932024-08-16T07:25:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
94942024-08-16T07:25:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
94952024-08-16T07:25:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94962024-08-16T07:25:21.290ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
94972024-08-16T07:25:21.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 9.212103ms iteration = 18 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
94982024-08-16T07:25:21.290ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
94992024-08-16T07:25:21.290ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
95002024-08-16T07:25:21.290ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95012024-08-16T07:25:21.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95022024-08-16T07:25:21.290ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95032024-08-16T07:25:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
95042024-08-16T07:25:21.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95052024-08-16T07:25:21.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95062024-08-16T07:25:21.291ZINFOnexus (BackgroundTasks): region snapshot replacement garbage collect task done background_task = region_snapshot_replacement_garbage_collection file = nexus/src/app/background/tasks/region_snapshot_replacement_garbage_collect.rs:147
95072024-08-16T07:25:21.291ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.785391ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
95082024-08-16T07:25:21.292ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95092024-08-16T07:25:21.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95102024-08-16T07:25:21.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95112024-08-16T07:25:21.292ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
95122024-08-16T07:25:21.292ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
95132024-08-16T07:25:21.292ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 3.619713ms iteration = 18 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
95142024-08-16T07:25:21.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95152024-08-16T07:25:21.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95162024-08-16T07:25:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
95172024-08-16T07:25:21.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95182024-08-16T07:25:21.293ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
95192024-08-16T07:25:21.293ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 9.996921ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
95202024-08-16T07:25:21.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
95212024-08-16T07:25:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95222024-08-16T07:25:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95232024-08-16T07:25:21.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
95242024-08-16T07:25:21.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95252024-08-16T07:25:21.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95262024-08-16T07:25:21.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95272024-08-16T07:25:21.294ZINFOnexus (BackgroundTasks): region snapshot replacement start task done background_task = region_snapshot_replacement_start file = nexus/src/app/background/tasks/region_snapshot_replacement_start.rs:252
95282024-08-16T07:25:21.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.19848ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
95292024-08-16T07:25:21.297ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
95302024-08-16T07:25:21.297ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 16.630175ms iteration = 20 status = {"physical_disks_added":0}
95312024-08-16T07:25:21.299ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
95322024-08-16T07:25:21.299ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.577569ms iteration = 52 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}
95332024-08-16T07:25:21.302ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95342024-08-16T07:25:21.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95352024-08-16T07:25:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95362024-08-16T07:25:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95372024-08-16T07:25:21.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95382024-08-16T07:25:21.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95392024-08-16T07:25:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95402024-08-16T07:25:21.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95412024-08-16T07:25:21.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95422024-08-16T07:25:21.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95432024-08-16T07:25:21.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95442024-08-16T07:25:21.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95452024-08-16T07:25:21.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae, lookup_type: ById(03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae) } result = Ok(())
95462024-08-16T07:25:21.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95472024-08-16T07:25:21.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95482024-08-16T07:25:21.307ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95492024-08-16T07:25:21.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95502024-08-16T07:25:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95512024-08-16T07:25:21.308ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 27.625758ms iteration = 18 status = 0
95522024-08-16T07:25:21.424ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
95532024-08-16T07:25:21.424ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95542024-08-16T07:25:21.424ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "64d072fc-3e81-4a96-bf55-59676e1bddb1", "content-length": "26", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
95552024-08-16T07:25:21.424ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95562024-08-16T07:25:21.425ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
95572024-08-16T07:25:21.425ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95582024-08-16T07:25:21.425ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95592024-08-16T07:25:21.426ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "936b3b66-cbb2-4c31-8765-e7c90adab29d", "content-length": "26", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
95602024-08-16T07:25:21.426ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95612024-08-16T07:25:21.427ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95622024-08-16T07:25:21.436ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95632024-08-16T07:25:21.436ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "314dcf20-ecdc-4840-9ceb-6ac40f32bc51", "content-length": "372", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
95642024-08-16T07:25:21.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95652024-08-16T07:25:21.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95662024-08-16T07:25:21.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95672024-08-16T07:25:21.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95682024-08-16T07:25:21.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95692024-08-16T07:25:21.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95702024-08-16T07:25:21.443ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95712024-08-16T07:25:21.444ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4d690ce6-9f56-4467-826d-320032ec27c4", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
95722024-08-16T07:25:21.445ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 156.827512ms iteration = 19 status = {}
95732024-08-16T07:25:21.524ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a zone_address = fd00:1122:3344:101::2
95742024-08-16T07:25:21.524ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95752024-08-16T07:25:21.524ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d5028448-932a-4821-88c6-946d58cccba3", "content-length": "26", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
95762024-08-16T07:25:21.524ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95772024-08-16T07:25:21.526ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
95782024-08-16T07:25:21.545ZDEBGnexus (BackgroundTasks): client request SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95792024-08-16T07:25:21.546ZDEBGnexus (BackgroundTasks): client response SledAgent = 03a0cf9d-3baf-4ea2-91ab-3c0c2a3421ae background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a8f2a6ef-93d4-4e16-8431-3035e82a3bd7", "content-length": "691", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
95802024-08-16T07:25:21.546ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
95812024-08-16T07:25:21.546ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
95822024-08-16T07:25:21.546ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
95832024-08-16T07:25:21.548ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 267.17405ms iteration = 18 status = {}
95842024-08-16T07:25:21.636ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
95852024-08-16T07:25:21.636ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "13774153-4caa-4006-ac6f-e421d4df934d", "content-length": "2", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
95862024-08-16T07:25:21.637ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95872024-08-16T07:25:21.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95882024-08-16T07:25:21.639ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 358.465369ms iteration = 18 status = null
95892024-08-16T07:25:21.642ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 361.525089ms iteration = 18 status = {}
95902024-08-16T07:25:21.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95912024-08-16T07:25:21.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95922024-08-16T07:25:21.696ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:146 port = SwitchPort { id: f13c0939-2c9d-4a0d-b006-5f3de89cc4fc, rack_id: e1b0d583-7b20-4a4b-97f9-9f83300aeb7a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb) } rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
95932024-08-16T07:25:21.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95942024-08-16T07:25:21.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95952024-08-16T07:25:21.705ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95962024-08-16T07:25:21.705ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd3d305f-540c-4834-ac9a-cf1108f39c45", "content-length": "121", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
95972024-08-16T07:25:21.705ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1663 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
95982024-08-16T07:25:21.705ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1690 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 4de7fcf8-2b1f-4b0e-ba6f-584e8a34addb
95992024-08-16T07:25:21.706ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
96002024-08-16T07:25:21.706ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
96012024-08-16T07:25:21.706ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
96022024-08-16T07:25:21.706ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a routes = {}
96032024-08-16T07:25:21.706ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a
96042024-08-16T07:25:21.706ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96052024-08-16T07:25:21.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96062024-08-16T07:25:21.708ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
96072024-08-16T07:25:21.708ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "481f3e1b-2979-4057-b3ab-ada850462f11", "content-length": "2", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
96082024-08-16T07:25:21.708ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
96092024-08-16T07:25:21.708ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4123eb95-feec-42c7-b6ae-94992bec5ed5", "content-length": "52", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
96102024-08-16T07:25:21.708ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch_location = Switch0
96112024-08-16T07:25:21.708ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
96122024-08-16T07:25:21.758ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5b5d5241-bd2d-4d19-99a8-bc69318d6dbf", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
96132024-08-16T07:25:21.758ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a switch = Switch0
96142024-08-16T07:25:21.758ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
96152024-08-16T07:25:21.759ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e1b0d583-7b20-4a4b-97f9-9f83300aeb7a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4de1f8a9-1fac-4611-b611-ceea9be738a8", "content-length": "494", "date": "Fri, 16 Aug 2024 07:25:20 GMT"} })
96162024-08-16T07:25:21.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96172024-08-16T07:25:21.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96182024-08-16T07:25:21.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96192024-08-16T07:25:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96202024-08-16T07:25:21.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96212024-08-16T07:25:21.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96222024-08-16T07:25:21.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96232024-08-16T07:25:21.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96242024-08-16T07:25:21.774ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 493.031027ms iteration = 18 status = {}
96252024-08-16T07:25:22.698ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45602
96262024-08-16T07:25:22.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45602 req_id = 19de87c3-04b4-4ef2-b35b-139b499065e9 roles = RoleSet { roles: {} } uri = /metrics/producers
96272024-08-16T07:25:22.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45602 req_id = 19de87c3-04b4-4ef2-b35b-139b499065e9 resource = Database result = Ok(()) uri = /metrics/producers
96282024-08-16T07:25:22.730ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 62147b68-6c5f-49df-a144-ebe1b87f0e27
96292024-08-16T07:25:22.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45602 req_id = 19de87c3-04b4-4ef2-b35b-139b499065e9 roles = RoleSet { roles: {} } uri = /metrics/producers
96302024-08-16T07:25:22.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45602 req_id = 19de87c3-04b4-4ef2-b35b-139b499065e9 resource = Database result = Ok(()) uri = /metrics/producers
96312024-08-16T07:25:22.738ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 uri = http://[fd00:1122:3344:101::d]:12223/producers
96322024-08-16T07:25:22.738ZDEBGnexus: client response oximeter-collector = 62147b68-6c5f-49df-a144-ebe1b87f0e27 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2463bc16-10c1-4b59-a3ff-8d613f4ac22a", "date": "Fri, 16 Aug 2024 07:25:21 GMT"} })
96332024-08-16T07:25:22.738ZINFOnexus: assigned collector to new producer collector_id = 62147b68-6c5f-49df-a144-ebe1b87f0e27 file = nexus/src/app/oximeter.rs:125 producer_id = b9b5cfb7-1d99-4535-948c-195d99b3bf69
96342024-08-16T07:25:22.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 41501 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45602 req_id = 19de87c3-04b4-4ef2-b35b-139b499065e9 response_code = 201 uri = /metrics/producers
96352024-08-16T07:25:23.195ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/52d900a/dropshot/src/server.rs:914 latency_us = 1333 local_addr = [fd00:1122:3344:101::b]:46346 method = GET remote_addr = [fd00:1122:3344:101::d]:52239 req_id = aae32d5c-f77b-4347-89ea-23adb5a0380c response_code = 200 uri = /09eed6fc-f2ea-4ebd-a66c-d8895818c00c
96362024-08-16T07:25:31.280ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
96372024-08-16T07:25:31.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96382024-08-16T07:25:31.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96392024-08-16T07:25:31.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96402024-08-16T07:25:31.283ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
96412024-08-16T07:25:31.283ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
96422024-08-16T07:25:31.283ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96432024-08-16T07:25:31.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96442024-08-16T07:25:31.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96452024-08-16T07:25:31.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96462024-08-16T07:25:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96472024-08-16T07:25:31.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96482024-08-16T07:25:31.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96492024-08-16T07:25:31.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96502024-08-16T07:25:31.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96512024-08-16T07:25:31.286ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
96522024-08-16T07:25:31.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.923047ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96532024-08-16T07:25:31.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96542024-08-16T07:25:31.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: caf7b37b-a2ed-40ca-95aa-b423c866615d, lookup_type: ById(caf7b37b-a2ed-40ca-95aa-b423c866615d) } result = Ok(())
96552024-08-16T07:25:31.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96562024-08-16T07:25:31.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96572024-08-16T07:25:31.294ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d original_time_created = 2024-08-16 07:16:39.904395 UTC target_id = caf7b37b-a2ed-40ca-95aa-b423c866615d time_created = 2024-08-16 07:16:39.904395 UTC
96582024-08-16T07:25:31.294ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.044774ms iteration = 53 status = {"status":"target blueprint unchanged","target_id":"caf7b37b-a2ed-40ca-95aa-b423c866615d","time_created":"2024-08-16T07:16:39.904395Z"}